Apr 17 15:19:36 user cinder-scheduler[84081]: INFO dbcounter [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Registered counter for database cinder Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writer thread running {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 15:19:36 user cinder-scheduler[84081]: INFO cinder.rpc [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 17 15:19:36 user cinder-scheduler[84081]: INFO cinder.rpc [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:19:36 user cinder-scheduler[84081]: INFO cinder.rpc [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Apr 17 15:19:36 user cinder-scheduler[84081]: INFO cinder.rpc [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Automatically selected cinder-backup RPC version 2.4 as minimum service version. Apr 17 15:19:36 user cinder-scheduler[84081]: INFO cinder.rpc [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 17 15:19:36 user cinder-scheduler[84081]: INFO cinder.rpc [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_concurrency.lockutils [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Acquiring lock "singleton_lock" {{(pid=84081) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_concurrency.lockutils [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Acquired lock "singleton_lock" {{(pid=84081) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_concurrency.lockutils [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Releasing lock "singleton_lock" {{(pid=84081) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] ******************************************************************************** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Configuration options gathered from: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] ================================================================================ {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] allow_availability_zone_fallback = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] allow_compression_on_image_upload = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] allowed_direct_url_schemes = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] api_rate_limit = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] auth_strategy = keystone {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] az_cache_duration = 3600 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backdoor_port = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backdoor_socket = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_availability_zone = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_api_class = cinder.backup.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_name_template = backup-%s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_use_same_host = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_use_temp_snapshot = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] capacity_weight_multiplier = 1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] chap_password = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] chap_username = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_internal_tenant_project_id = 2ef07a6150b7438d850c124674d4e245 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_internal_tenant_user_id = 7e22f9ab9d1c42a29166bf831687159a {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cloned_volume_same_az = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] compression_format = gzip {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] compute_api_class = cinder.compute.nova.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] config_dir = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] config_source = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] control_exchange = openstack {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] debug = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] default_availability_zone = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] default_group_type = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] default_volume_type = joviandss-2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_client_cert = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_client_cert_key = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_data_namespace = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_ssl_cert_path = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_ssl_cert_verify = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_use_ssl = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enable_force_upload = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enable_new_services = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enable_unsupported_driver = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enabled_backends = ['joviandss-2'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enforce_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] filter_function = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_api_insecure = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_api_servers = ['http://10.0.0.210/image'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_api_ssl_compression = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_ca_certificates_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_catalog_info = image:glance:publicURL {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_num_retries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_request_timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] goodness_function = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] graceful_shutdown_timeout = 5 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] group_api_class = cinder.group.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] host = user {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iet_conf = /etc/iet/ietd.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_compress_on_upload = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_conversion_address_space_limit = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_conversion_cpu_limit = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_conversion_disable = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_upload_use_cinder_backend = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_upload_use_internal_tenant = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_volume_cache_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_volume_cache_max_count = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_volume_cache_max_size_gb = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] instance_format = [instance: %(uuid)s] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iscsi_iotype = fileio {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iscsi_target_flags = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iscsi_write_cache = on {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iser_helper = tgtadm {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iser_ip_address = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iser_port = 3260 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_config_append = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_dir = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_options = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_rotate_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_rotate_interval_type = days {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_rotation_type = none {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] max_age = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] max_logfile_count = 30 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] max_logfile_size_mb = 200 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] max_over_subscription_ratio = 20.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] message_reap_interval = 86400 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] message_ttl = 2592000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] monkey_patch = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] monkey_patch_modules = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] my_ip = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] no_snapshot_gb_quota = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] num_iser_scan_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] num_shell_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] num_volume_device_scan_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nvmeof_conn_info_version = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nvmet_ns_id = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nvmet_port_id = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_max_limit = 1000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_ext_list = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_listen_port = 8776 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_use_ssl = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_workers = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] per_volume_size_limit = -1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] periodic_fuzzy_delay = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] periodic_interval = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] public_endpoint = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] publish_errors = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_backup_gigabytes = 1000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_backups = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_consistencygroups = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_gigabytes = 1000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_groups = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_snapshots = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_volumes = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rate_limit_burst = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rate_limit_except_level = CRITICAL {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rate_limit_interval = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] replication_device = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] report_discard_supported = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] report_interval = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] reservation_clean_interval = 86400 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] reservation_expire = 86400 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] reserved_image_namespaces = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] reserved_percentage = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rpc_response_timeout = 120 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] run_external_periodic_tasks = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_driver_init_wait_time = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_json_config_location = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_max_attempts = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scst_target_driver = iscsi {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scst_target_iqn_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_down_time = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] snapshot_name_template = snapshot-%s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] snapshot_same_host = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] split_loggers = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] state_path = /opt/stack/data/cinder {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] storage_availability_zone = nova {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] storage_protocol = iSCSI {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] syslog_log_facility = LOG_USER {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_helper = lioadm {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_ip_address = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_port = 3260 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_protocol = iscsi {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_secondary_ip_addresses = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] trace_flags = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] transport_url = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] until_refresh = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_chap_auth = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_default_quota_class = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_eventlog = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_journal = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_json = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_stderr = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_syslog = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] verify_glance_signatures = enabled {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_api_class = cinder.volume.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_backend_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_clear = zero {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_clear_ionice = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_clear_size = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_copy_bps_limit = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_dd_blocksize = 1M {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_name_template = volume-%s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_number_multiplier = -1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_usage_audit_period = month {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] watch_log_file = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_concurrency.disable_process_locking = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.admin_password = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.admin_token = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.admin_user = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_port = 35357 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_protocol = https {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_section = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_type = password {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_uri = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_version = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.cache = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.identity_uri = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.include_service_catalog = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.insecure = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.interface = public {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.region_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.service_type = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.backend = dogpile.cache.null {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.backend_argument = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.config_prefix = cache.oslo {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.dead_timeout = 60.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.debug_cache_backend = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.enable_retry_client = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.enable_socket_keepalive = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.expiration_time = 600 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.hashclient_retry_attempts = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.hashclient_retry_delay = 1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_dead_retry = 300 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_password = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_pool_maxsize = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_sasl_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_socket_timeout = 1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_username = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.proxies = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.retry_attempts = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.retry_delay = 0.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.socket_keepalive_count = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.socket_keepalive_idle = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.socket_keepalive_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_allowed_ciphers = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_cafile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] coordination.backend_url = etcd3+http://10.0.0.210:2379 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.backend = sqlalchemy {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection_debug = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection_parameters = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection_recycle_time = 3600 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection_trace = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.db_inc_retry_interval = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.db_max_retries = 20 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.db_max_retry_interval = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.db_retry_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.max_overflow = 50 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.max_pool_size = 5 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.max_retries = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.mysql_enable_ndb = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.mysql_wsrep_sync_wait = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.pool_timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.retry_interval = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.slave_connection = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.sqlite_synchronous = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.use_db_reconnect = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.enforce_new_defaults = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.enforce_scope = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.policy_default_rule = default {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.policy_file = policy.yaml {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.connection_string = messaging:// {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.es_doc_type = notification {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.es_scroll_size = 10000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.es_scroll_time = 2m {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.filter_error_trace = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.hmac_keys = SECRET_KEY {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.sentinel_service_name = mymaster {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.socket_timeout = 0.1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.trace_sqlalchemy = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] os_brick.lock_path = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.capabilities = [21] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.group = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.helper_command = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.user = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.group = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.helper_command = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.thread_pool_size = 12 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.user = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.auth_section = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.auth_type = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.cafile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.collect_timing = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.insecure = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.send_service_user_token = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.split_loggers = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.backend_availability_zone = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.chap_password = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.chap_username = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_client_cert = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_client_cert_key = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_data_namespace = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_use_ssl = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.filter_function = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.goodness_function = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iscsi_iotype = fileio {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iscsi_target_flags = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iscsi_write_cache = on {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iser_helper = tgtadm {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iser_ip_address = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iser_port = 3260 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.num_shell_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.replication_device = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.report_discard_supported = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.reserved_percentage = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_helper = tgtadm {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_ip_address = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_port = 3260 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_protocol = iscsi {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.trace_flags = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.unique_fqdn_network = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.use_chap_auth = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_backend_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_clear = zero {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_clear_ionice = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_clear_size = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_reports.file_event_handler = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_reports.log_dir = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_notifications.driver = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_notifications.retry = -1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.auth_section = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.auth_type = password {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.collect_timing = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.insecure = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.interface = public {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.region_name = RegionOne {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.split_loggers = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.token_auth_url = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] ******************************************************************************** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Full set of CONF: {{(pid=84081) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] ******************************************************************************** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] Configuration options gathered from: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] ================================================================================ {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] allocated_capacity_weight_multiplier = -1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] allow_availability_zone_fallback = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] allow_compression_on_image_upload = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] allowed_direct_url_schemes = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] api_rate_limit = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] auth_strategy = keystone {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] az_cache_duration = 3600 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backdoor_port = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backdoor_socket = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_availability_zone = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_api_class = cinder.backup.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_name_template = backup-%s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_use_same_host = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backup_use_temp_snapshot = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] capacity_weight_multiplier = 1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] chap_password = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] chap_username = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_internal_tenant_project_id = 2ef07a6150b7438d850c124674d4e245 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_internal_tenant_user_id = 7e22f9ab9d1c42a29166bf831687159a {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cloned_volume_same_az = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] compression_format = gzip {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] compute_api_class = cinder.compute.nova.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] config_dir = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] config_source = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] control_exchange = openstack {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] debug = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] default_availability_zone = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] default_group_type = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] default_volume_type = joviandss-2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_client_cert = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_client_cert_key = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_data_namespace = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_ssl_cert_path = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_ssl_cert_verify = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] driver_use_ssl = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enable_force_upload = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enable_new_services = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enable_unsupported_driver = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enabled_backends = ['joviandss-2'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] enforce_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] filter_function = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_api_insecure = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_api_servers = ['http://10.0.0.210/image'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_api_ssl_compression = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_ca_certificates_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_catalog_info = image:glance:publicURL {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_num_retries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] glance_request_timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] goodness_function = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] graceful_shutdown_timeout = 5 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] group_api_class = cinder.group.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] host = user {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iet_conf = /etc/iet/ietd.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_compress_on_upload = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_conversion_address_space_limit = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_conversion_cpu_limit = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_conversion_disable = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_upload_use_cinder_backend = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_upload_use_internal_tenant = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_volume_cache_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_volume_cache_max_count = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] image_volume_cache_max_size_gb = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] instance_format = [instance: %(uuid)s] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iscsi_iotype = fileio {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iscsi_target_flags = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iscsi_write_cache = on {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iser_helper = tgtadm {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iser_ip_address = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iser_port = 3260 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_config_append = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_dir = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_options = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_rotate_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_rotate_interval_type = days {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] log_rotation_type = none {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] max_age = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] max_logfile_count = 30 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] max_logfile_size_mb = 200 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] max_over_subscription_ratio = 20.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] message_reap_interval = 86400 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] message_ttl = 2592000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] monkey_patch = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] monkey_patch_modules = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] my_ip = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] no_snapshot_gb_quota = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] num_iser_scan_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] num_shell_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] num_volume_device_scan_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nvmeof_conn_info_version = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nvmet_ns_id = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nvmet_port_id = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_max_limit = 1000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_ext_list = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_listen_port = 8776 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_use_ssl = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] osapi_volume_workers = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] per_volume_size_limit = -1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] periodic_fuzzy_delay = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] periodic_interval = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] public_endpoint = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] publish_errors = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_backup_gigabytes = 1000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_backups = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_consistencygroups = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_gigabytes = 1000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_groups = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_snapshots = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] quota_volumes = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rate_limit_burst = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rate_limit_except_level = CRITICAL {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rate_limit_interval = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] replication_device = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] report_discard_supported = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] report_interval = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] reservation_clean_interval = 86400 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] reservation_expire = 86400 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] reserved_image_namespaces = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] reserved_percentage = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] rpc_response_timeout = 120 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] run_external_periodic_tasks = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_default_filters = ['AvailabilityZoneFilter', 'CapacityFilter', 'CapabilitiesFilter'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_default_weighers = ['CapacityWeigher'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_driver = cinder.scheduler.filter_scheduler.FilterScheduler {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_driver_init_wait_time = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_host_manager = cinder.scheduler.host_manager.HostManager {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_json_config_location = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_max_attempts = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scheduler_weight_handler = cinder.scheduler.weights.OrderedHostWeightHandler {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scst_target_driver = iscsi {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] scst_target_iqn_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_down_time = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] snapshot_name_template = snapshot-%s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] snapshot_same_host = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] split_loggers = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] state_path = /opt/stack/data/cinder {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] storage_availability_zone = nova {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] storage_protocol = iSCSI {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] syslog_log_facility = LOG_USER {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_helper = lioadm {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_ip_address = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_port = 3260 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_protocol = iscsi {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] target_secondary_ip_addresses = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] trace_flags = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] transport_url = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] until_refresh = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_chap_auth = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_default_quota_class = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_eventlog = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_journal = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_json = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_stderr = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] use_syslog = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] verify_glance_signatures = enabled {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_api_class = cinder.volume.api.API {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_backend_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_clear = zero {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_clear_ionice = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_clear_size = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_copy_bps_limit = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_dd_blocksize = 1M {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_name_template = volume-%s {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_number_multiplier = -1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volume_usage_audit_period = month {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] watch_log_file = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_concurrency.disable_process_locking = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.admin_password = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.admin_token = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.admin_user = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_admin_prefix = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_port = 35357 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_protocol = https {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_section = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_type = password {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_uri = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.auth_version = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.cache = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.identity_uri = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.include_service_catalog = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.insecure = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.interface = public {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.region_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.service_token_roles_required = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.service_type = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.backend = dogpile.cache.null {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.backend_argument = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.config_prefix = cache.oslo {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.dead_timeout = 60.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.debug_cache_backend = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.enable_retry_client = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.enable_socket_keepalive = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.expiration_time = 600 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.hashclient_retry_attempts = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.hashclient_retry_delay = 1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_dead_retry = 300 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_password = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_pool_maxsize = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_sasl_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_socket_timeout = 1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.memcache_username = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.proxies = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.retry_attempts = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.retry_delay = 0.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.socket_keepalive_count = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.socket_keepalive_idle = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.socket_keepalive_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_allowed_ciphers = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_cafile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cache.tls_keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] coordination.backend_url = etcd3+http://10.0.0.210:2379 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.backend = sqlalchemy {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection_debug = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection_parameters = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection_recycle_time = 3600 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.connection_trace = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.db_inc_retry_interval = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.db_max_retries = 20 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.db_max_retry_interval = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.db_retry_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.max_overflow = 50 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.max_pool_size = 5 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.max_retries = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.mysql_enable_ndb = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.mysql_wsrep_sync_wait = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.pool_timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.retry_interval = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.slave_connection = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.sqlite_synchronous = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] database.use_db_reconnect = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.enforce_new_defaults = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.enforce_scope = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.policy_default_rule = default {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.policy_file = policy.yaml {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.connection_string = messaging:// {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.es_doc_type = notification {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.es_scroll_size = 10000 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.es_scroll_time = 2m {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.filter_error_trace = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.hmac_keys = SECRET_KEY {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.sentinel_service_name = mymaster {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.socket_timeout = 0.1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] profiler.trace_sqlalchemy = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] os_brick.lock_path = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.capabilities = [21] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.group = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.helper_command = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] privsep_osbrick.user = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.group = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.helper_command = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.thread_pool_size = 12 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] cinder_sys_admin.user = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.auth_section = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.auth_type = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.cafile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.collect_timing = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.insecure = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.send_service_user_token = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.split_loggers = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] service_user.timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.backend_availability_zone = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.chap_password = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.chap_username = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_client_cert = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_client_cert_key = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_data_namespace = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.driver_use_ssl = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.filter_function = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.goodness_function = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iscsi_iotype = fileio {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iscsi_target_flags = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iscsi_write_cache = on {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iser_helper = tgtadm {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iser_ip_address = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iser_port = 3260 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.num_shell_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.replication_device = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.report_discard_supported = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.reserved_percentage = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_helper = tgtadm {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_ip_address = 10.0.0.210 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_port = 3260 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_protocol = iscsi {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.trace_flags = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.unique_fqdn_network = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.use_chap_auth = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_backend_name = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_clear = zero {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_clear_ionice = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_clear_size = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_reports.file_event_handler = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_reports.log_dir = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_notifications.driver = [] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_notifications.retry = -1 {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.auth_section = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.auth_type = password {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.certfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.collect_timing = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.insecure = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.interface = public {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.keyfile = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.region_name = RegionOne {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.split_loggers = False {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.timeout = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] nova.token_auth_url = None {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG oslo_service.service [None req-381b263d-ddd0-4f47-8e30-3e19759303d8 None None] ******************************************************************************** {{(pid=84081) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 17 15:19:36 user cinder-scheduler[84081]: INFO cinder.service [-] Starting cinder-scheduler node (version 22.1.0) Apr 17 15:19:36 user cinder-scheduler[84081]: INFO cinder.manager [None req-3b20b4ad-2eb6-4961-88ce-95ff1160029b None None] Initiating service 1 cleanup Apr 17 15:19:36 user cinder-scheduler[84081]: INFO cinder.manager [None req-3b20b4ad-2eb6-4961-88ce-95ff1160029b None None] Service 1 cleanup completed. Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-3b20b4ad-2eb6-4961-88ce-95ff1160029b None None] Creating RPC server for service cinder-scheduler {{(pid=84081) start /opt/stack/cinder/cinder/service.py:238}} Apr 17 15:19:36 user cinder-scheduler[84081]: DEBUG cinder.service [None req-3b20b4ad-2eb6-4961-88ce-95ff1160029b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84081) start /opt/stack/cinder/cinder/service.py:244}} Apr 17 15:19:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-56c536ad-a672-42a0-ad8f-80bf0f9c4548 None None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:19:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-56c536ad-a672-42a0-ad8f-80bf0f9c4548 None None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 19, 42, 755626)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:19:42 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-56c536ad-a672-42a0-ad8f-80bf0f9c4548 None None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:19:44 user cinder-scheduler[84081]: DEBUG oslo_service.periodic_task [None req-f34b314c-8efb-4039-8358-8e5e4b72f628 None None] Running periodic task SchedulerManager._clean_expired_messages {{(pid=84081) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 17 15:19:44 user cinder-scheduler[84081]: INFO cinder.message.api [None req-f34b314c-8efb-4039-8358-8e5e4b72f628 None None] Deleted 0 expired messages. Apr 17 15:19:44 user cinder-scheduler[84081]: DEBUG oslo_service.periodic_task [None req-f34b314c-8efb-4039-8358-8e5e4b72f628 None None] Running periodic task SchedulerManager._clean_expired_reservation {{(pid=84081) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 17 15:20:13 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=34,cinder:INSERT=1,cinder:DELETE=1,cinder:UPDATE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:20:53 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:21:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6043453d-8f04-48e3-8aab-54d871043d6e None None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:21:23 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:21:53 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:22:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c16752d3-8e6e-492f-a8c5-c58e8339737a None None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:22:23 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:22:53 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:23:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-22b77711-9480-4be7-9daa-bf8d5040a760 None None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:23:23 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Flow 'volume_create_scheduler' (d48b2cde-8663-4d48-be89-cfc95220dee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9043ab5f-7698-4af8-8f32-38a7be9fb247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9043ab5f-7698-4af8-8f32-38a7be9fb247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c5f04e05-b556-4cb3-84c8-590aa69695b0),volume_id=c5f04e05-b556-4cb3-84c8-590aa69695b0,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1b0cddab-8950-4149-b704-bcb4de64e106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 16, 583068)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (c5f04e05-b556-4cb3-84c8-590aa69695b0) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 0, 'calculated_free_capacity': 119.0, 'virtual_free_capacity': 106, 'free_percent': 89.08, 'provisioned_ratio': 0.0, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/106 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 0, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 0, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:16.583068] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Weigher CapacityWeigher returned, weigher value is {max: 106, min: 106} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 1, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:26.175275 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1b0cddab-8950-4149-b704-bcb4de64e106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-05b47da9-26a7-4ab0-966e-6fa0f3f58ac6 tempest-VolumesTestJSON-1329991747 None] Flow 'volume_create_scheduler' (d48b2cde-8663-4d48-be89-cfc95220dee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Flow 'volume_create_scheduler' (e724f8d6-8ac0-4fc4-a453-0690ec24a6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b7a38acd-a78c-4623-b094-4989454dd564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b7a38acd-a78c-4623-b094-4989454dd564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(90683e1b-58ef-42b7-8ebf-85f478ece679),volume_id=90683e1b-58ef-42b7-8ebf-85f478ece679,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bffe3f6f-1e5c-4652-a8ac-cf5d873bb5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 16, 583068)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (90683e1b-58ef-42b7-8ebf-85f478ece679) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 1, 'calculated_free_capacity': 118.0, 'virtual_free_capacity': 105, 'free_percent': 88.24, 'provisioned_ratio': 0.01, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/105 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 1, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 1, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:26.175275] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Weigher CapacityWeigher returned, weigher value is {max: 105, min: 105} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 2, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:26.387397 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bffe3f6f-1e5c-4652-a8ac-cf5d873bb5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-773249cb-bb44-4155-b636-73558e12aaff tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Flow 'volume_create_scheduler' (e724f8d6-8ac0-4fc4-a453-0690ec24a6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 16, 583068)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 2, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:26.387397] {{(pid=84081) _get_weighted_candidates_by_group_type /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:529}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 104, min: 104} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 16, 583068)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 2, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:26.387397] {{(pid=84081) _get_weighted_candidates_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:436}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 104, min: 104} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-0dec2be9-e768-4b8e-805b-db306db439de tempest-GroupSnapshotsTest-1926061586 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:604}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Flow 'volume_create_scheduler' (96ea9616-2b5f-4d26-9951-aa7f62eb891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (843b41a8-6af5-4fb8-b45c-c802e9d1a35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (843b41a8-6af5-4fb8-b45c-c802e9d1a35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=203550cd-a3a4-4ff5-bfe6-6ed2607e334b,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(74f7ff47-86dd-433a-8a61-f46278efe3fd),volume_id=74f7ff47-86dd-433a-8a61-f46278efe3fd,volume_properties=VolumeProperties,volume_type=VolumeType(a40cb290-464c-4f83-9d6b-adf225cc2e0c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f715dc26-bd5d-44fb-bd9e-21766dc49dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 16, 583068)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (74f7ff47-86dd-433a-8a61-f46278efe3fd) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 104, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 2, 'calculated_free_capacity': 117.0, 'virtual_free_capacity': 104, 'free_percent': 87.39, 'provisioned_ratio': 0.02, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/104 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 2, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:26.387397] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 104, min: 104} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 3, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:28.262951 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f715dc26-bd5d-44fb-bd9e-21766dc49dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ff28d70d-3957-4e48-97d2-741aa067698b tempest-GroupSnapshotsTest-1926061586 None] Flow 'volume_create_scheduler' (96ea9616-2b5f-4d26-9951-aa7f62eb891b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Flow 'volume_create_scheduler' (1a02c697-855b-4199-84de-951f28bcaf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0b7accdd-135c-45e4-998b-b9ba35bd83a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0b7accdd-135c-45e4-998b-b9ba35bd83a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f8f9aea9-6773-4928-9e8e-153c3796301b),volume_id=f8f9aea9-6773-4928-9e8e-153c3796301b,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4947ef16-ea77-4529-99f9-25b84c9bbbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 16, 583068)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f8f9aea9-6773-4928-9e8e-153c3796301b) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 103, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 3, 'calculated_free_capacity': 116.0, 'virtual_free_capacity': 103, 'free_percent': 86.55, 'provisioned_ratio': 0.03, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/103 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 3, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:28.262951] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Weigher CapacityWeigher returned, weigher value is {max: 103, min: 103} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 4, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:29.232962 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4947ef16-ea77-4529-99f9-25b84c9bbbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7cf58784-5a09-4291-b5b9-ad092863a300 tempest-VolumesTestJSON-1329991747 None] Flow 'volume_create_scheduler' (1a02c697-855b-4199-84de-951f28bcaf1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Flow 'volume_create_scheduler' (c005a249-3f0f-477f-9933-8a49e79462cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e8f5759-ed66-4c15-b423-4e9554d78f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e8f5759-ed66-4c15-b423-4e9554d78f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e03a489c-cc11-4ae5-bf0d-f270a6a5ee02),volume_id=e03a489c-cc11-4ae5-bf0d-f270a6a5ee02,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (37ce183a-baf9-46b0-96de-9bf2f94216fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:31 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 16, 583068)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (e03a489c-cc11-4ae5-bf0d-f270a6a5ee02) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 102, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 4, 'calculated_free_capacity': 115.0, 'virtual_free_capacity': 102, 'free_percent': 85.71, 'provisioned_ratio': 0.03, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/102 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 4, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 4, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:29.232962] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Weigher CapacityWeigher returned, weigher value is {max: 102, min: 102} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 5, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:32.006445 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (37ce183a-baf9-46b0-96de-9bf2f94216fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-088501df-e36c-4cae-82f0-c986294f5da9 tempest-VolumesTestJSON-1329991747 None] Flow 'volume_create_scheduler' (c005a249-3f0f-477f-9933-8a49e79462cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 0, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 16, 583068)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 101, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 5, 'calculated_free_capacity': 114.0, 'virtual_free_capacity': 101, 'free_percent': 84.87, 'provisioned_ratio': 0.04, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/101 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 5, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:32.006445] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 101, min: 101} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-b4d0b80e-1b78-415e-ab7c-90da14a8eb7b tempest-GroupSnapshotsTest-1926061586 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 6, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:34.248723 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-bf4316d4-7553-4c02-9fad-8509117f5729 tempest-VolumeQuotasNegativeTestJSON-2121978028 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 4, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:23:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-21eb6b89-a742-42f1-9d2f-4bcf12a902bc tempest-VolumesTestJSON-1329991747 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 4, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8991a11b-9d09-425a-8267-3a06c24ef669 tempest-GroupSnapshotsTest-1926061586 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 4, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:23:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a3d4b2c6-26c9-497e-8932-f55143203bdd tempest-VolumesTestJSON-1329991747 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 3, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:23:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-16e1020c-fa96-497c-86b8-f8a35e1f0dfb tempest-VolumesTestJSON-1329991747 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 2, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3057b4d3-c7b5-4dbd-8911-ddf44a44c1e7 tempest-GroupSnapshotsTest-1926061586 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 2, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 2, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 51, 433353)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 2, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:51.433353] {{(pid=84081) _get_weighted_candidates_by_group_type /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:529}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 106, min: 106} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 2, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 51, 433353)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 2, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:51.433353] {{(pid=84081) _get_weighted_candidates_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:436}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 106, min: 106} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-3c81aaab-1504-4ec3-ace1-79b934b9bbd8 tempest-GroupSnapshotsTest-1926061586 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:604}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Flow 'volume_create_scheduler' (ce078dbf-e337-4229-a7f1-8c53755001ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (279b77d9-fc57-44b7-b5b1-62c14d8ee0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (279b77d9-fc57-44b7-b5b1-62c14d8ee0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=286e53b0-285a-4d83-8cd3-cb2b5641b31f,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7249f8e4-ed4b-4689-aba3-2766c924f42c),volume_id=7249f8e4-ed4b-4689-aba3-2766c924f42c,volume_properties=VolumeProperties,volume_type=VolumeType(73c9cbe6-d3bc-4af2-810c-855e0b88bd3f))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ef5e9059-7870-49b4-b96d-7d1fbbae3eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 2, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 51, 433353)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7249f8e4-ed4b-4689-aba3-2766c924f42c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 2, 'calculated_free_capacity': 117.0, 'virtual_free_capacity': 106, 'free_percent': 89.08, 'provisioned_ratio': 0.02, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/106 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 2, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 2, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:51.433353] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 106, min: 106} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 3, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:53.255634 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=16,cinder:SELECT=84 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ef5e9059-7870-49b4-b96d-7d1fbbae3eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5f9b222b-dc4a-4328-8276-c24281b88b12 tempest-GroupSnapshotsTest-1926061586 None] Flow 'volume_create_scheduler' (ce078dbf-e337-4229-a7f1-8c53755001ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Flow 'volume_create_scheduler' (532e26b9-933d-4b1c-9b55-4ae6a1b27b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f8a3aaa1-73b9-4860-a9a9-a39f8a361219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f8a3aaa1-73b9-4860-a9a9-a39f8a361219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ff4859e2-8777-4959-8da6-2086553c6247),volume_id=ff4859e2-8777-4959-8da6-2086553c6247,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0a850758-7224-4f0c-bc93-56ed33f651ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 2, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 51, 433353)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Checking if host user@joviandss-2#joviandss-2 can create a 2 GB volume (ff4859e2-8777-4959-8da6-2086553c6247) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 3, 'calculated_free_capacity': 116.0, 'virtual_free_capacity': 105, 'free_percent': 88.24, 'provisioned_ratio': 0.03, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 2/105 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 3, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 3, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:53.255634] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Weigher CapacityWeigher returned, weigher value is {max: 105, min: 105} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Consumed 2 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 5, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:55.490008 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0a850758-7224-4f0c-bc93-56ed33f651ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f2715cc1-a4b1-4939-9297-fae00819ee03 tempest-VolumesCloneNegativeTest-166008807 None] Flow 'volume_create_scheduler' (532e26b9-933d-4b1c-9b55-4ae6a1b27b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Flow 'volume_create_scheduler' (620e7e9b-5494-4921-a1e0-9907d947dcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f3a4b68d-16a0-4974-bbab-9a5aa62ab053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f3a4b68d-16a0-4974-bbab-9a5aa62ab053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=286e53b0-285a-4d83-8cd3-cb2b5641b31f,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f6603de5-71d3-468b-a673-ce1ff5cd1285),volume_id=f6603de5-71d3-468b-a673-ce1ff5cd1285,volume_properties=VolumeProperties,volume_type=VolumeType(73c9cbe6-d3bc-4af2-810c-855e0b88bd3f))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (75d08c2d-5c2b-4980-955e-f114bfd70df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 2, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 51, 433353)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f6603de5-71d3-468b-a673-ce1ff5cd1285) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 103, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 5, 'calculated_free_capacity': 114.0, 'virtual_free_capacity': 103, 'free_percent': 86.55, 'provisioned_ratio': 0.04, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/103 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 5, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:55.490008] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 103, min: 103} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 6, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:56.105629 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (75d08c2d-5c2b-4980-955e-f114bfd70df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47c0924f-fe01-4cbe-b793-24ff6b90fa3a tempest-GroupSnapshotsTest-1926061586 None] Flow 'volume_create_scheduler' (620e7e9b-5494-4921-a1e0-9907d947dcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Flow 'volume_create_scheduler' (5bc653b7-4cc3-4cb1-9f9b-1780a58f2d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c7550fdf-06b0-4248-af97-29d0f41e5c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c7550fdf-06b0-4248-af97-29d0f41e5c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(53ff0d0b-94f7-4575-bb23-81cac29166fe),volume_id=53ff0d0b-94f7-4575-bb23-81cac29166fe,volume_properties=VolumeProperties,volume_type=VolumeType(5d7108d1-10ea-4a52-bbef-e6ef8e5b8983))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3d12ee27-c434-4419-a66d-a2658e6d5378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 2, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 51, 433353)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (53ff0d0b-94f7-4575-bb23-81cac29166fe) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 102, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 6, 'calculated_free_capacity': 113.0, 'virtual_free_capacity': 102, 'free_percent': 85.71, 'provisioned_ratio': 0.05, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/102 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 6, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:56.105629] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Weigher CapacityWeigher returned, weigher value is {max: 102, min: 102} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 7, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 7, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:56.484540 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3d12ee27-c434-4419-a66d-a2658e6d5378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:23:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f771c1-c99f-4537-96d6-3b271ab54578 tempest-VolumeTypesAccessTest-1000893842 None] Flow 'volume_create_scheduler' (5bc653b7-4cc3-4cb1-9f9b-1780a58f2d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Flow 'volume_create_scheduler' (230d6bb0-e1fc-48a4-a6c1-6db290668393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7ea5a629-e0fc-4dad-9516-84b56a526cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7ea5a629-e0fc-4dad-9516-84b56a526cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c74b7878-4936-4015-8b63-142923947310),volume_id=c74b7878-4936-4015-8b63-142923947310,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0592ec89-0b14-4089-87ba-362fb8a1c418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 2, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 23, 51, 433353)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (c74b7878-4936-4015-8b63-142923947310) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 101, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 7, 'calculated_free_capacity': 112.0, 'virtual_free_capacity': 101, 'free_percent': 84.87, 'provisioned_ratio': 0.06, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/101 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 7, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 7, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:23:56.484540] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Weigher CapacityWeigher returned, weigher value is {max: 101, min: 101} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 8, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 8, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:00.697824 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0592ec89-0b14-4089-87ba-362fb8a1c418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-564420f3-c6f7-4553-9d71-dade6adb0bfb tempest-TaggedBootDevicesTest_v242-1317742003 None] Flow 'volume_create_scheduler' (230d6bb0-e1fc-48a4-a6c1-6db290668393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d9e3d6c8-17ef-48d6-8d2c-c3d4f35bd575 tempest-VolumesCloneNegativeTest-166008807 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 6, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-245cebd8-8396-4696-af5e-f63f63c4f353 tempest-VolumeTypesAccessTest-1000893842 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 5, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Flow 'volume_create_scheduler' (5c42d633-6119-4b05-889e-e1df7d5181fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (32b6ece1-3f53-42d6-80e6-ff84eb6d8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (32b6ece1-3f53-42d6-80e6-ff84eb6d8643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(66000c93-eb12-4c23-8a69-71e1aa6b521f),volume_id=66000c93-eb12-4c23-8a69-71e1aa6b521f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8f8522be-6ec2-4dbb-b945-97e37de648f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 5, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 4, 874722)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (66000c93-eb12-4c23-8a69-71e1aa6b521f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 5, 'calculated_free_capacity': 114.0, 'virtual_free_capacity': 106, 'free_percent': 89.08, 'provisioned_ratio': 0.04, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/106 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 5, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 5, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:04.874722] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Weigher CapacityWeigher returned, weigher value is {max: 106, min: 106} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 6, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:07.735389 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8f8522be-6ec2-4dbb-b945-97e37de648f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-01e53132-32f6-458d-8c41-044e160c456f tempest-TestVolumeSwap-1714109745 None] Flow 'volume_create_scheduler' (5c42d633-6119-4b05-889e-e1df7d5181fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (1d7ff051-a15d-4375-a362-c597abbb4723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (94effbd1-4cd9-473a-91fa-f6e770c89862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (94effbd1-4cd9-473a-91fa-f6e770c89862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f088992b-786a-4641-8bcc-5cb7c819d313),volume_id=f088992b-786a-4641-8bcc-5cb7c819d313,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (77cda415-80f5-4e32-89ab-5c97d6782c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 5, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 4, 874722)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f088992b-786a-4641-8bcc-5cb7c819d313) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 6, 'calculated_free_capacity': 113.0, 'virtual_free_capacity': 105, 'free_percent': 88.24, 'provisioned_ratio': 0.05, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/105 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 6, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 6, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:07.735389] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Weigher CapacityWeigher returned, weigher value is {max: 105, min: 105} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 7, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 7, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:08.398834 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (77cda415-80f5-4e32-89ab-5c97d6782c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c11ecf3-dc04-4262-bc9d-a7dd71483cc5 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (1d7ff051-a15d-4375-a362-c597abbb4723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Flow 'volume_create_scheduler' (b6e969c9-5e7f-401b-a5dd-07edd529f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7508b77f-ee87-4aa7-be4f-c50cca7e4ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7508b77f-ee87-4aa7-be4f-c50cca7e4ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(485ea70c-618d-4373-a78f-a460914fc095),volume_id=485ea70c-618d-4373-a78f-a460914fc095,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4194ad53-316d-439d-a797-09d198709dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 5, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 4, 874722)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (485ea70c-618d-4373-a78f-a460914fc095) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 104, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 7, 'calculated_free_capacity': 112.0, 'virtual_free_capacity': 104, 'free_percent': 87.39, 'provisioned_ratio': 0.06, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/104 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 7, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 7, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:08.398834] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Weigher CapacityWeigher returned, weigher value is {max: 104, min: 104} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 8, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 8, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:11.482339 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=17,cinder:SELECT=83 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4194ad53-316d-439d-a797-09d198709dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7f100682-2aaa-4d0e-9177-e13846976f68 tempest-TestVolumeSwap-1714109745 None] Flow 'volume_create_scheduler' (b6e969c9-5e7f-401b-a5dd-07edd529f350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (61f2a327-6993-4e4d-ae4c-8e6fe207f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0c7a1aae-7b18-4cf5-8a9d-2e179c1068a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0c7a1aae-7b18-4cf5-8a9d-2e179c1068a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f93cf40a-0d85-4277-91a8-d85037f79e7a),volume_id=f93cf40a-0d85-4277-91a8-d85037f79e7a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7ec197b0-7f90-41ee-a54b-2faa124de371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 5, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 4, 874722)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f93cf40a-0d85-4277-91a8-d85037f79e7a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 103, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 8, 'calculated_free_capacity': 111.0, 'virtual_free_capacity': 103, 'free_percent': 86.55, 'provisioned_ratio': 0.07, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/103 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 8, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 8, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:11.482339] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Weigher CapacityWeigher returned, weigher value is {max: 103, min: 103} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 9, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 9, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:11.771029 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7ec197b0-7f90-41ee-a54b-2faa124de371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70b57e1d-a47a-45c2-837a-39eda91c984d tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (61f2a327-6993-4e4d-ae4c-8e6fe207f886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Flow 'volume_create_scheduler' (d3b7db89-f5b1-4c3a-9aa4-98e9027f7b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d1d9a003-299f-45b4-b599-643f72d2f9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d1d9a003-299f-45b4-b599-643f72d2f9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a),volume_id=3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d30cb5d3-4fcf-40fb-8508-07ac62d4f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 5, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 4, 874722)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (3c05f4f0-17a8-4f4c-9987-1fcb502ffd3a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 102, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 9, 'calculated_free_capacity': 110.0, 'virtual_free_capacity': 102, 'free_percent': 85.71, 'provisioned_ratio': 0.08, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/102 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 9, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 9, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:11.771029] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Weigher CapacityWeigher returned, weigher value is {max: 102, min: 102} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 10, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 10, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:14.665927 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d30cb5d3-4fcf-40fb-8508-07ac62d4f251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ac753b94-fda1-4a0a-a55a-df6da267ee4d tempest-TaggedAttachmentsTest-1309189231 None] Flow 'volume_create_scheduler' (d3b7db89-f5b1-4c3a-9aa4-98e9027f7b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Flow 'volume_create_scheduler' (5a5427ca-d298-4bd0-873f-b0053c1f6110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d092a8f7-4261-4646-8b5a-cde7883afd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d092a8f7-4261-4646-8b5a-cde7883afd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(786b4c79-f126-4791-8350-4fed7646bd3b),volume_id=786b4c79-f126-4791-8350-4fed7646bd3b,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e7926b68-a862-4a83-948b-fd791f93d7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 5, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 4, 874722)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (786b4c79-f126-4791-8350-4fed7646bd3b) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 101, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 10, 'calculated_free_capacity': 109.0, 'virtual_free_capacity': 101, 'free_percent': 84.87, 'provisioned_ratio': 0.08, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/101 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 10, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 10, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:14.665927] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Weigher CapacityWeigher returned, weigher value is {max: 101, min: 101} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 11, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 11, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:16.112384 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e7926b68-a862-4a83-948b-fd791f93d7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e933b70a-f56c-4690-8a4f-79fe3eb067fd tempest-VolumesTransfersTest-276179586 None] Flow 'volume_create_scheduler' (5a5427ca-d298-4bd0-873f-b0053c1f6110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7dfa1002-a20d-4c87-ba84-9833407a1ca3 None None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 11, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-b5809a81-b0b1-43e3-93ac-27311b059c17 tempest-VolumesGetTest-1961901732 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 10, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (e498b883-da66-4a0d-97c2-93558cd2e116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4273c104-71ab-41ca-870b-1fb542f91bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4273c104-71ab-41ca-870b-1fb542f91bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9a8586a6-f2f5-4bee-a56f-a06b01120c39),volume_id=9a8586a6-f2f5-4bee-a56f-a06b01120c39,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4ea70d33-f4fd-417c-a444-74abc8f05e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f7fe6c6b-6bf3-4a20-9298-2c754b555694 tempest-VolumesTransfersTest-450487945 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 8, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 8, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 25, 689421)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (9a8586a6-f2f5-4bee-a56f-a06b01120c39) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 8, 'calculated_free_capacity': 111.0, 'virtual_free_capacity': 106, 'free_percent': 89.08, 'provisioned_ratio': 0.07, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/106 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 8, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 8, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:25.689421] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Weigher CapacityWeigher returned, weigher value is {max: 106, min: 106} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 9, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 9, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:25.713456 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4ea70d33-f4fd-417c-a444-74abc8f05e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c3c39056-e984-4f53-8f45-8ecd6577db98 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (e498b883-da66-4a0d-97c2-93558cd2e116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ce906aff-8139-4f35-93dd-d0256428c52f tempest-VolumesGetTest-1961901732 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 9, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Flow 'volume_create_scheduler' (2e774e99-0525-4eb7-b0a3-f0174cc6148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f35c8ce1-78d4-4ec4-b974-5cb205d72eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f35c8ce1-78d4-4ec4-b974-5cb205d72eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bd3bcf59-72e2-43c9-973a-ab5956dc83b5),volume_id=bd3bcf59-72e2-43c9-973a-ab5956dc83b5,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2d3baa6a-aa74-4cf9-80c3-b8f796852afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 9, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 25, 984930)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bd3bcf59-72e2-43c9-973a-ab5956dc83b5) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 9, 'calculated_free_capacity': 110.0, 'virtual_free_capacity': 106, 'free_percent': 89.08, 'provisioned_ratio': 0.08, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/106 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 9, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 9, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:25.984930] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Weigher CapacityWeigher returned, weigher value is {max: 106, min: 106} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 10, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 10, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:26.430493 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2d3baa6a-aa74-4cf9-80c3-b8f796852afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d360ab42-9868-4c50-8361-153e346a5879 tempest-VolumesTransfersTest-276179586 None] Flow 'volume_create_scheduler' (2e774e99-0525-4eb7-b0a3-f0174cc6148d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (91b2b16f-32f3-4522-b876-038c454235e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3579a81f-10e7-4867-a53b-ce82ebc0dcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3579a81f-10e7-4867-a53b-ce82ebc0dcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend='user@joviandss-2#joviandss-2',snapshot_id=None,source_replicaid=,source_volid=9a8586a6-f2f5-4bee-a56f-a06b01120c39,volume=Volume(fa8e71d4-54a7-4e0d-9a26-50cc7946ce11),volume_id=fa8e71d4-54a7-4e0d-9a26-50cc7946ce11,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c3881a19-f2a7-417e-8921-bc5a1206a517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 9, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 25, 984930)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (fa8e71d4-54a7-4e0d-9a26-50cc7946ce11) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 10, 'calculated_free_capacity': 109.0, 'virtual_free_capacity': 105, 'free_percent': 88.24, 'provisioned_ratio': 0.08, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/105 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 10, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 10, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:26.430493] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Weigher CapacityWeigher returned, weigher value is {max: 105, min: 105} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 11, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 11, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:28.568343 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c3881a19-f2a7-417e-8921-bc5a1206a517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ffc97846-e2d4-4147-ab93-bc7ab1830c90 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (91b2b16f-32f3-4522-b876-038c454235e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Flow 'volume_create_scheduler' (59b75b51-7dff-49d9-8bcb-48f3c93e915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7fd48c7f-fe8b-4db1-9fb3-a90be42ba06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7fd48c7f-fe8b-4db1-9fb3-a90be42ba06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(18475864-c202-4937-b18f-cc3e16c6d89f),volume_id=18475864-c202-4937-b18f-cc3e16c6d89f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7c57fa40-70bb-4ad4-86d8-ff726eafb34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 9, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 25, 984930)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (18475864-c202-4937-b18f-cc3e16c6d89f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 104, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 11, 'calculated_free_capacity': 108.0, 'virtual_free_capacity': 104, 'free_percent': 87.39, 'provisioned_ratio': 0.09, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/104 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 11, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 11, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:28.568343] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Weigher CapacityWeigher returned, weigher value is {max: 104, min: 104} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 12, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 12, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:33.294881 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7c57fa40-70bb-4ad4-86d8-ff726eafb34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f476fc78-3409-48a7-af27-d8fd19176ff4 tempest-TaggedBootDevicesTest_v242-1317742003 None] Flow 'volume_create_scheduler' (59b75b51-7dff-49d9-8bcb-48f3c93e915d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=84,cinder:UPDATE=16 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (f5d6e1cb-00f2-45d6-88ef-31ab4a0355fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a6dbe90f-ffc5-4b49-a44f-39e3b1af74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a6dbe90f-ffc5-4b49-a44f-39e3b1af74d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a90b7acc-e20a-4e97-9004-f18d7a2b4c98),volume_id=a90b7acc-e20a-4e97-9004-f18d7a2b4c98,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7ab07058-a1ea-4300-95a7-204b4d4a5759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 9, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 25, 984930)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a90b7acc-e20a-4e97-9004-f18d7a2b4c98) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 103, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 12, 'calculated_free_capacity': 107.0, 'virtual_free_capacity': 103, 'free_percent': 86.55, 'provisioned_ratio': 0.1, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/103 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 12, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 12, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:33.294881] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Weigher CapacityWeigher returned, weigher value is {max: 103, min: 103} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 13, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 13, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:33.756111 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7ab07058-a1ea-4300-95a7-204b4d4a5759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e706d105-4a69-45fd-a85e-bbcb2970af50 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (f5d6e1cb-00f2-45d6-88ef-31ab4a0355fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-733c2b3a-fb60-4425-8809-eceac0525109 tempest-VolumesTransfersTest-450487945 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 13, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Flow 'volume_create_scheduler' (e9d78741-3dea-4d93-9dad-5b896cdffb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (037b4f94-0168-4f5c-ac32-ae09de5c5620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (037b4f94-0168-4f5c-ac32-ae09de5c5620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(65a7c5eb-3af6-4afd-918f-ccb69a68641c),volume_id=65a7c5eb-3af6-4afd-918f-ccb69a68641c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e424eba8-6cea-4146-9e2b-7fc8a11a8c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 13, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 35, 318159)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (65a7c5eb-3af6-4afd-918f-ccb69a68641c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 13, 'calculated_free_capacity': 106.0, 'virtual_free_capacity': 106.0, 'free_percent': 89.08, 'provisioned_ratio': 0.11, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/106.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 13, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 13, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:35.318159] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Weigher CapacityWeigher returned, weigher value is {max: 106.0, min: 106.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 14, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 14, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:35.826541 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e424eba8-6cea-4146-9e2b-7fc8a11a8c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dafb15d5-01b7-4803-8d19-6ae0af274656 tempest-TaggedBootDevicesTest_v242-1317742003 None] Flow 'volume_create_scheduler' (e9d78741-3dea-4d93-9dad-5b896cdffb58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cb0bf660-4169-4302-b2c3-1ebf4db895fa tempest-GroupSnapshotsTest-1926061586 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 37, 362811)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 14, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 14, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:37.362811] {{(pid=84081) _get_weighted_candidates_by_group_type /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:529}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 105.0, min: 105.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 37, 362811)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 14, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 14, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:37.362811] {{(pid=84081) _get_weighted_candidates_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:436}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 105.0, min: 105.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-b10140cb-27c9-4b38-8d11-d2ade8c0d299 tempest-GroupSnapshotsTest-1926061586 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:604}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Flow 'volume_create_scheduler' (bd29a93f-f20d-4640-8e2a-325fa48a94b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (28905871-0738-44b3-9322-ed7583b02e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (28905871-0738-44b3-9322-ed7583b02e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=83f168f7-009f-4ecb-8cda-bee4f351f951,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7a71a6fd-8167-40ab-b057-5f82e0f55947),volume_id=7a71a6fd-8167-40ab-b057-5f82e0f55947,volume_properties=VolumeProperties,volume_type=VolumeType(2fbbd4b4-c823-4693-8ac9-0db5fcafba0b))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1cd5e68d-3dcb-4445-b079-dea62f21833a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 37, 362811)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7a71a6fd-8167-40ab-b057-5f82e0f55947) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 14, 'calculated_free_capacity': 105.0, 'virtual_free_capacity': 105.0, 'free_percent': 88.24, 'provisioned_ratio': 0.12, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/105.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 14, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 14, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:37.362811] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Weigher CapacityWeigher returned, weigher value is {max: 105.0, min: 105.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:39.339109 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1cd5e68d-3dcb-4445-b079-dea62f21833a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1cf647d2-902a-4e0a-b37a-c4223cf1233b tempest-GroupSnapshotsTest-1926061586 None] Flow 'volume_create_scheduler' (bd29a93f-f20d-4640-8e2a-325fa48a94b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Flow 'volume_create_scheduler' (a911205c-be97-483a-9a33-fb407a4084cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3242fe2c-97a9-477b-9df7-1540dbbe319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3242fe2c-97a9-477b-9df7-1540dbbe319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4b0ebe2e-141a-40f1-bcb5-83708d103f54),volume_id=4b0ebe2e-141a-40f1-bcb5-83708d103f54,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (83a902c3-b2b2-4ece-b30f-7c13387a93c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 37, 362811)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4b0ebe2e-141a-40f1-bcb5-83708d103f54) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 15, 'calculated_free_capacity': 104.0, 'virtual_free_capacity': 104.0, 'free_percent': 87.39, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/104.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:39.339109] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Weigher CapacityWeigher returned, weigher value is {max: 104.0, min: 104.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:40.978227 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (83a902c3-b2b2-4ece-b30f-7c13387a93c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-274966fd-0736-4b94-9044-21d5db896776 tempest-VolumesExtendTest-93540250 None] Flow 'volume_create_scheduler' (a911205c-be97-483a-9a33-fb407a4084cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8ef70554-d4a6-4df0-9a96-76278ba9c85b tempest-VolumesGetTest-1961901732 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 15, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 15, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 41, 168069)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Checking if host user@joviandss-2#joviandss-2 can extend the volume 4b0ebe2e-141a-40f1-bcb5-83708d103f54 in 1 GB {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:50}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 15, 'calculated_free_capacity': 104.0, 'virtual_free_capacity': 104.0, 'free_percent': 87.39, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/104.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:41.168069] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Weigher CapacityWeigher returned, weigher value is {max: 104.0, min: 104.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-43baaf2b-5b0a-4273-b977-215eaa56cd2d tempest-VolumesExtendTest-93540250 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:45.680170 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-54dde4b2-8343-4ef5-8f0f-d617a0a46a99 tempest-VolumesGetTest-1961901732 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 15, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (5816de11-83a3-4f5d-9597-ddc14f13ca10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (60beeb0b-17a7-49c3-a877-b672c218e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (60beeb0b-17a7-49c3-a877-b672c218e699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(3982de76-ea42-41a0-b8e5-4b24b489009b),volume_id=3982de76-ea42-41a0-b8e5-4b24b489009b,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b6a4ccd3-8da7-46ea-b54d-1d33571a276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-50e02017-ce73-4ed4-9f96-0a01c81adea4 tempest-VolumesGetTest-1961901732 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 50, 637978)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (3982de76-ea42-41a0-b8e5-4b24b489009b) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 14, 'calculated_free_capacity': 105.0, 'virtual_free_capacity': 105.0, 'free_percent': 88.24, 'provisioned_ratio': 0.12, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/105.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 14, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 14, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:50.637978] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Weigher CapacityWeigher returned, weigher value is {max: 105.0, min: 105.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:50.697191 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b6a4ccd3-8da7-46ea-b54d-1d33571a276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-7303fa52-959d-4a80-9bb5-5cd76868f509 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (5816de11-83a3-4f5d-9597-ddc14f13ca10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Flow 'volume_create_scheduler' (936dee63-ba27-4456-96f3-1bf54de17cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8ba521b0-95ae-40c5-b536-6b1a450de924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8ba521b0-95ae-40c5-b536-6b1a450de924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(31d34366-a0ee-4a52-822b-79de201b5a12),volume_id=31d34366-a0ee-4a52-822b-79de201b5a12,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e254fe04-d816-422d-b7e9-0977cbfcb3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 50, 637978)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (31d34366-a0ee-4a52-822b-79de201b5a12) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 15, 'calculated_free_capacity': 104.0, 'virtual_free_capacity': 104.0, 'free_percent': 87.39, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/104.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:50.697191] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Weigher CapacityWeigher returned, weigher value is {max: 104.0, min: 104.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:51.751101 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e254fe04-d816-422d-b7e9-0977cbfcb3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-57c4caf5-947d-4d53-8d87-afb00c52f60a tempest-VolumesExtendTest-93540250 None] Flow 'volume_create_scheduler' (936dee63-ba27-4456-96f3-1bf54de17cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8502c4c2-1b69-4858-a3b9-7f3876102a3e tempest-VolumesExtendTest-93540250 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 52, 68347)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 14, 'calculated_free_capacity': 105.0, 'virtual_free_capacity': 105.0, 'free_percent': 88.24, 'provisioned_ratio': 0.12, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/105.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 14, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 14, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:52.068347] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Weigher CapacityWeigher returned, weigher value is {max: 105.0, min: 105.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99f3e477-abde-4bf2-8835-cd1893dacfd6 tempest-VolumesExtendTest-93540250 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:54.060190 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=84,cinder:UPDATE=16 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (1e3450b1-401b-40f6-8e55-bdec2c5a9bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3d399e07-eb23-4048-a32b-698204a13104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3d399e07-eb23-4048-a32b-698204a13104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(6e83844e-db12-47e9-b1b9-acd2e0f7d31a),volume_id=6e83844e-db12-47e9-b1b9-acd2e0f7d31a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5f538e95-a512-4571-ad4a-7632af1ee32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 14, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 52, 68347)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (6e83844e-db12-47e9-b1b9-acd2e0f7d31a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 15, 'calculated_free_capacity': 104.0, 'virtual_free_capacity': 104.0, 'free_percent': 87.39, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/104.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:54.060190] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Weigher CapacityWeigher returned, weigher value is {max: 104.0, min: 104.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:55.595081 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5f538e95-a512-4571-ad4a-7632af1ee32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5fb13a1c-30cf-4428-98db-437f48b42dd6 tempest-VolumesGetTest-1961901732 None] Flow 'volume_create_scheduler' (1e3450b1-401b-40f6-8e55-bdec2c5a9bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-b126ed32-230c-4823-8d14-03ab093a03a3 tempest-GroupSnapshotsTest-1926061586 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 15, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 15, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 55, 822311)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Checking if host user@joviandss-2#joviandss-2 can extend the volume 31d34366-a0ee-4a52-822b-79de201b5a12 in 1 GB {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:50}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 15, 'calculated_free_capacity': 104.0, 'virtual_free_capacity': 104.0, 'free_percent': 87.39, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/104.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:55.822311] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Weigher CapacityWeigher returned, weigher value is {max: 104.0, min: 104.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-30662506-e322-4033-9ea6-c910941899bb tempest-VolumesExtendTest-93540250 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:57.371719 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Flow 'volume_create_scheduler' (d961b753-12e1-4ced-9c24-1f12fb03b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b240330c-d25f-415b-9441-5150bc6aba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b240330c-d25f-415b-9441-5150bc6aba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(29534406-54ef-4f00-9568-69ae248eae21),volume_id=29534406-54ef-4f00-9568-69ae248eae21,volume_properties=VolumeProperties,volume_type=VolumeType(5f3a1ff8-565b-4399-ab5f-1d26e9b981fe))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3f909f9b-af0e-4763-8113-331a80d829b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 15, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 24, 55, 822311)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (29534406-54ef-4f00-9568-69ae248eae21) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 16, 'calculated_free_capacity': 103.0, 'virtual_free_capacity': 103.0, 'free_percent': 86.55, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/103.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:57.371719] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Weigher CapacityWeigher returned, weigher value is {max: 103.0, min: 103.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 17, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 17, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:24:59.722188 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3f909f9b-af0e-4763-8113-331a80d829b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e901a82d-2ea1-4b10-a528-c1880ebdb240 tempest-VolumeTypesTest-1824483253 None] Flow 'volume_create_scheduler' (d961b753-12e1-4ced-9c24-1f12fb03b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:25:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5ddb6e37-cf4a-4825-831b-16072286044b tempest-VolumesGetTest-1961901732 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:25:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 25, 2, 255971)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:25:04 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:25:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:25:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:25:02.255971] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:25:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Weigher CapacityWeigher returned, weigher value is {max: 103.0, min: 103.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:25:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:25:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-14897f06-95d2-4866-b6a0-c80278ef170a tempest-VolumesGetTest-1961901732 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 13, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:25:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-25c80733-a960-453f-9159-ec587e0787bf tempest-VolumesExtendTest-93540250 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 13, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:25:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-56e853c8-d1bd-490d-9734-edcd1d06128c tempest-VolumeTypesTest-1824483253 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 13, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:25:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f4767ed7-e4fa-4c0c-bd0b-b48a0034e6c0 tempest-VolumeTypesTest-1824483253 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 12, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:25:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8ae0015f-1eb3-49f5-a51a-f1619d5bd2c6 None None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 12, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:INSERT=1,cinder:SELECT=36,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Flow 'volume_create_scheduler' (155d5072-e8ad-4d3c-ad5a-5c57b99f361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (15587533-37da-411d-be03-25764764e62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (15587533-37da-411d-be03-25764764e62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d895d11d-6880-4418-a9ad-feca813ed5d6),volume_id=d895d11d-6880-4418-a9ad-feca813ed5d6,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (76a1ea8e-f315-43e9-8aa5-abbb27a0856d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 12, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 25, 16, 743214)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (d895d11d-6880-4418-a9ad-feca813ed5d6) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 12, 'calculated_free_capacity': 107.0, 'virtual_free_capacity': 106, 'free_percent': 89.08, 'provisioned_ratio': 0.1, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/106 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 12, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 12, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:25:16.743214] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Weigher CapacityWeigher returned, weigher value is {max: 106, min: 106} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 13, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 13, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:25:25.246991 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (76a1ea8e-f315-43e9-8aa5-abbb27a0856d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:25:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99b77dd0-765c-4f80-8074-39dde517bfa3 tempest-TestShelveInstance-1683612675 None] Flow 'volume_create_scheduler' (155d5072-e8ad-4d3c-ad5a-5c57b99f361a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Flow 'volume_create_scheduler' (7aea3c8a-9894-4447-8781-271a2aa8e050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4862a86f-b90b-4f1c-8e31-8740bf5ba647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4862a86f-b90b-4f1c-8e31-8740bf5ba647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a5f9d059-9f1b-4cf5-ae89-92bcf6c50326),volume_id=a5f9d059-9f1b-4cf5-ae89-92bcf6c50326,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fccbd574-33f3-4f84-888a-ecb486ab371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 12, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 25, 16, 743214)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a5f9d059-9f1b-4cf5-ae89-92bcf6c50326) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 13, 'calculated_free_capacity': 106.0, 'virtual_free_capacity': 105, 'free_percent': 88.24, 'provisioned_ratio': 0.11, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/105 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 13, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 13, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:25:25.246991] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Weigher CapacityWeigher returned, weigher value is {max: 105, min: 105} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 14, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 14, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:25:33.663244 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fccbd574-33f3-4f84-888a-ecb486ab371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:25:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a728e6aa-455a-49d8-9c3f-ede168768691 tempest-DeleteServersTestJSON-1458225442 None] Flow 'volume_create_scheduler' (7aea3c8a-9894-4447-8781-271a2aa8e050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (b9603da8-f5af-45ee-95ab-5f810a62e398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5f9a95dd-2813-42ba-8b94-b0824eb37121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5f9a95dd-2813-42ba-8b94-b0824eb37121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(13bf568b-585c-4556-ab78-e9930ad50214),volume_id=13bf568b-585c-4556-ab78-e9930ad50214,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4b30f60b-9692-45be-b627-8ac94a5e15f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 12, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 25, 16, 743214)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (13bf568b-585c-4556-ab78-e9930ad50214) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 104, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 14, 'calculated_free_capacity': 105.0, 'virtual_free_capacity': 104, 'free_percent': 87.39, 'provisioned_ratio': 0.12, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/104 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 14, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 14, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:25:33.663244] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Weigher CapacityWeigher returned, weigher value is {max: 104, min: 104} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:25:53.315137 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4b30f60b-9692-45be-b627-8ac94a5e15f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:25:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7888f03-9769-4460-9438-25f7adb5e7b9 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (b9603da8-f5af-45ee-95ab-5f810a62e398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:26:03 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=42,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (c0b4a9dc-a3bf-480e-a5c2-1d2dd17715b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (72616d90-2554-4f5a-b272-a80580e0ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (72616d90-2554-4f5a-b272-a80580e0ef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(215a6a5b-25ca-48fa-a8e3-72416d7a39e2),volume_id=215a6a5b-25ca-48fa-a8e3-72416d7a39e2,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (60812cd0-a9c5-41eb-98e1-dd79a8170054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 12, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 25, 16, 743214)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (215a6a5b-25ca-48fa-a8e3-72416d7a39e2) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 103, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 15, 'calculated_free_capacity': 104.0, 'virtual_free_capacity': 103, 'free_percent': 86.55, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/103 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 15, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 15, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:25:53.315137] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Weigher CapacityWeigher returned, weigher value is {max: 103, min: 103} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:26:08.442501 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (60812cd0-a9c5-41eb-98e1-dd79a8170054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:26:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8de17766-ca0a-45d7-9093-3c083ab4c48d tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (c0b4a9dc-a3bf-480e-a5c2-1d2dd17715b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Flow 'volume_create_scheduler' (cde06927-830e-410c-aa4f-a959b31b6fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f2c94a50-2015-47cd-92d8-2c7a1558a657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f2c94a50-2015-47cd-92d8-2c7a1558a657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf63d38e-00b8-46cb-acce-fda3fd9b6a9f),volume_id=bf63d38e-00b8-46cb-acce-fda3fd9b6a9f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8282a5d7-f07c-4d39-973c-b44751387d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 12, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 25, 16, 743214)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bf63d38e-00b8-46cb-acce-fda3fd9b6a9f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 102, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 16, 'calculated_free_capacity': 103.0, 'virtual_free_capacity': 102, 'free_percent': 85.71, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/102 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:26:08.442501] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Weigher CapacityWeigher returned, weigher value is {max: 102, min: 102} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:26:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 17, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 17, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:26:13.981803 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:26:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8282a5d7-f07c-4d39-973c-b44751387d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:26:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-70844f65-4304-4cd9-8174-1f52cac4dcfd tempest-AttachSCSIVolumeTestJSON-944917744 None] Flow 'volume_create_scheduler' (cde06927-830e-410c-aa4f-a959b31b6fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:26:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a638bc21-2c58-4f4c-bb88-1a7535cc33ac None None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 17, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:26:33 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=33,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:26:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-928c2c4b-8430-48c9-b964-08ab40043521 tempest-DeleteServersTestJSON-1458225442 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:26:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e548490-439f-45cc-8be1-15a2a34a8247 tempest-BackendsCapabilitiesAdminTestsJSON-1595981469 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 26, 43, 783549)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:26:51 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-2e548490-439f-45cc-8be1-15a2a34a8247 tempest-BackendsCapabilitiesAdminTestsJSON-1595981469 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:26:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e3c89327-156a-4d5e-9111-c3356c7662bc tempest-BackendsCapabilitiesAdminTestsJSON-1595981469 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 26, 43, 783549)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:26:51 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-e3c89327-156a-4d5e-9111-c3356c7662bc tempest-BackendsCapabilitiesAdminTestsJSON-1595981469 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 26, 43, 783549)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:26:43.783549] {{(pid=84081) _get_weighted_candidates_by_group_type /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:529}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Weigher CapacityWeigher returned, weigher value is {max: 103.0, min: 103.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 26, 43, 783549)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:26:43.783549] {{(pid=84081) _get_weighted_candidates_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:436}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Weigher CapacityWeigher returned, weigher value is {max: 103.0, min: 103.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:26:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-25550f17-2d1f-4ce2-87bd-fbb40384387d tempest-GroupSnapshotsV319Test-531716155 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:604}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Flow 'volume_create_scheduler' (f8835ed2-c4b4-4c8b-80e4-7f78e7c9362a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7080adc7-c49f-4f00-b607-f046d0e01b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7080adc7-c49f-4f00-b607-f046d0e01b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=7cfa2150-9d68-4591-b1b3-bd3a13002e9e,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(d5a81ad1-94ca-4688-9d1d-2d953807886e),volume_id=d5a81ad1-94ca-4688-9d1d-2d953807886e,volume_properties=VolumeProperties,volume_type=VolumeType(3710bfe6-8491-42c0-8fc3-c1f34b0279ed))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac81085c-f312-4782-931f-440ba99bbdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 26, 43, 783549)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (d5a81ad1-94ca-4688-9d1d-2d953807886e) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 16, 'calculated_free_capacity': 103.0, 'virtual_free_capacity': 103.0, 'free_percent': 86.55, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/103.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:26:43.783549] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Weigher CapacityWeigher returned, weigher value is {max: 103.0, min: 103.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 17, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 17, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:26:56.807385 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac81085c-f312-4782-931f-440ba99bbdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:26:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-edcc7e4e-9e9b-4c4f-80de-91c579e36770 tempest-GroupSnapshotsV319Test-531716155 None] Flow 'volume_create_scheduler' (f8835ed2-c4b4-4c8b-80e4-7f78e7c9362a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=7,cinder:SELECT=30 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (eca79de2-cc8f-46cf-a8ec-063cb028278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4e81e0b5-015a-453f-95cf-8ec6eb778a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4e81e0b5-015a-453f-95cf-8ec6eb778a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7d13a2d4-818a-4fbe-961d-1cd3c7a4cc75),volume_id=7d13a2d4-818a-4fbe-961d-1cd3c7a4cc75,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2131f993-2501-48de-856a-675d07983597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 26, 43, 783549)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7d13a2d4-818a-4fbe-961d-1cd3c7a4cc75) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 17, 'calculated_free_capacity': 102.0, 'virtual_free_capacity': 102.0, 'free_percent': 85.71, 'provisioned_ratio': 0.14, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/102.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 17, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 17, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:26:56.807385] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 102.0, min: 102.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:09.350093 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2131f993-2501-48de-856a-675d07983597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6a324b90-a845-4cbf-a525-b6a8ba5fe285 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (eca79de2-cc8f-46cf-a8ec-063cb028278f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-805f6e6b-96bf-4188-8fef-61d9e93617c2 tempest-GroupSnapshotsV319Test-531716155 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 18, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Flow 'volume_create_scheduler' (4223cb63-343f-4a19-8248-bc74e7d6c9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (367f18fe-081a-448f-b34c-238ecb376d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (367f18fe-081a-448f-b34c-238ecb376d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(11b50ce4-5220-4297-91e0-e1c6dae2f734),volume_id=11b50ce4-5220-4297-91e0-e1c6dae2f734,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b9146fec-c16b-4719-aa97-c8218f31f3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 18, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 13, 755434)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (11b50ce4-5220-4297-91e0-e1c6dae2f734) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 18, 'calculated_free_capacity': 101.0, 'virtual_free_capacity': 101.0, 'free_percent': 84.87, 'provisioned_ratio': 0.15, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/101.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:13.755434] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Weigher CapacityWeigher returned, weigher value is {max: 101.0, min: 101.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 19, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 19, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:15.052314 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b9146fec-c16b-4719-aa97-c8218f31f3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1204bfec-a970-49c4-83e9-d36f3df48c1f tempest-VolumesImageMetadata-1836508373 None] Flow 'volume_create_scheduler' (4223cb63-343f-4a19-8248-bc74e7d6c9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7d3cd5ee-28f9-489c-a0bb-8f70c44af132 None None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 19, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:27:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-7985a04f-f20c-4e04-8b5b-ceee9484c226 tempest-VolumesActionsTest-707453245 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 18, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:27:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-abb58d60-b907-4eab-8061-b333e35be167 tempest-VolumesImageMetadata-1836508373 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 17, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:27:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-72a330be-4562-4f8d-a314-3a6d1e24e684 tempest-AttachSCSIVolumeTestJSON-944917744 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (3d5cde32-05d1-4b2d-9224-a12a85095647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (20ad339b-89a3-49ad-b0e2-c95f3a3f9ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (20ad339b-89a3-49ad-b0e2-c95f3a3f9ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(1072d05f-2ebb-4398-902c-902df25464e9),volume_id=1072d05f-2ebb-4398-902c-902df25464e9,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (020b41bf-b669-40c9-90bd-0a6ce18b1ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 35, 832706)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (1072d05f-2ebb-4398-902c-902df25464e9) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 16, 'calculated_free_capacity': 103.0, 'virtual_free_capacity': 103.0, 'free_percent': 86.55, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/103.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:35.832706] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Weigher CapacityWeigher returned, weigher value is {max: 103.0, min: 103.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 17, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 17, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:38.723580 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (020b41bf-b669-40c9-90bd-0a6ce18b1ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a82ad222-921f-4371-a335-9977ac4c8cb7 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (3d5cde32-05d1-4b2d-9224-a12a85095647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=42,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Flow 'volume_create_scheduler' (8f986aa8-124a-44f8-ba9c-94c6ac4fe47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (753ca094-6009-433c-a44d-bb3bcb1c2271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (753ca094-6009-433c-a44d-bb3bcb1c2271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(32819ec1-2236-465f-a1c7-ee31aa4a0911),volume_id=32819ec1-2236-465f-a1c7-ee31aa4a0911,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b14597a-7699-4394-a8fb-b17cca3d8e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 35, 832706)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (32819ec1-2236-465f-a1c7-ee31aa4a0911) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 17, 'calculated_free_capacity': 102.0, 'virtual_free_capacity': 102.0, 'free_percent': 85.71, 'provisioned_ratio': 0.14, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/102.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 17, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 17, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:38.723580] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Weigher CapacityWeigher returned, weigher value is {max: 102.0, min: 102.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:42.488537 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b14597a-7699-4394-a8fb-b17cca3d8e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-074d632d-94df-495c-b8ee-f8f421be37e3 tempest-ServerStableDeviceRescueTest-869290889 None] Flow 'volume_create_scheduler' (8f986aa8-124a-44f8-ba9c-94c6ac4fe47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Flow 'volume_create_scheduler' (53ded9c9-2e6f-4803-a0f8-484c328e69ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a1284f12-956f-4417-9216-719e1a798c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a1284f12-956f-4417-9216-719e1a798c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a9c177a1-61f0-4201-bb8d-7f18c9af396c),volume_id=a9c177a1-61f0-4201-bb8d-7f18c9af396c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5062a62e-bebb-46a2-8e5f-e1eb3c707a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 35, 832706)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a9c177a1-61f0-4201-bb8d-7f18c9af396c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 104, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 18, 'calculated_free_capacity': 101.0, 'virtual_free_capacity': 101.0, 'free_percent': 84.87, 'provisioned_ratio': 0.15, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/101.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:42.488537] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Weigher CapacityWeigher returned, weigher value is {max: 101.0, min: 101.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 19, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 19, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:44.784657 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5062a62e-bebb-46a2-8e5f-e1eb3c707a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:27:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-085d5231-e63e-4c3f-980c-e7ecad1da4e8 tempest-TestStampPattern-173447269 None] Flow 'volume_create_scheduler' (53ded9c9-2e6f-4803-a0f8-484c328e69ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:27:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-da8a8d24-05f3-4009-ae8e-bb439b06abdd tempest-TaggedBootDevicesTest_v242-1317742003 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 18, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:27:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-43b6f4d5-2620-4b6b-bf68-03834735566f tempest-TaggedBootDevicesTest_v242-1317742003 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 17, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:27:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-122fd13e-6b37-4630-a7df-3990d5d9f41d tempest-TaggedBootDevicesTest_v242-1317742003 None] Received volume service update from user@joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None} {{(pid=84081) update_service_capabilities /opt/stack/cinder/cinder/scheduler/host_manager.py:628}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (e04b9da8-3e0e-4beb-907e-fcfcde027e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c493356c-cabe-41bd-8cec-f2b2a1997299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c493356c-cabe-41bd-8cec-f2b2a1997299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(62709a81-268b-4227-ba4a-070034f36414),volume_id=62709a81-268b-4227-ba4a-070034f36414,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5f37cce2-775b-4b44-a366-2983df39dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.utils [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Trying to retrieve max_over_subscription_ratio from a service that does not support thin provisioning {{(pid=84081) calculate_max_over_subscription_ratio /opt/stack/cinder/cinder/utils.py:880}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (62709a81-268b-4227-ba4a-070034f36414) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 106, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 16, 'calculated_free_capacity': 103.0, 'virtual_free_capacity': 103.0, 'free_percent': 86.55, 'provisioned_ratio': 0.13, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/103.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 106, total_capacity_gb: 119, allocated_capacity_gb: 16, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 16, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:27:55.236480] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 103.0, min: 103.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 17, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 17, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:28:12.522065 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5f37cce2-775b-4b44-a366-2983df39dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:28:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (e04b9da8-3e0e-4beb-907e-fcfcde027e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Flow 'volume_create_scheduler' (0716fce1-39ba-4519-8b8a-e85b6f9ecdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6586f1c7-930c-43b2-826d-4ae51484fa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6586f1c7-930c-43b2-826d-4ae51484fa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf),volume_id=17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fd6ec413-0061-4588-9b29-2e68a77c0b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 105, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 17, 'calculated_free_capacity': 102.0, 'virtual_free_capacity': 102.0, 'free_percent': 85.71, 'provisioned_ratio': 0.14, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/102.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 105, total_capacity_gb: 119, allocated_capacity_gb: 17, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 17, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:28:12.522065] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Weigher CapacityWeigher returned, weigher value is {max: 102.0, min: 102.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:28:22.454837 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fd6ec413-0061-4588-9b29-2e68a77c0b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:28:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Flow 'volume_create_scheduler' (0716fce1-39ba-4519-8b8a-e85b6f9ecdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:28:43 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=28,cinder:UPDATE=6 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (2c9835c2-a4ff-4b85-b2cf-1e8041665c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2903823e-6134-4733-97c8-6a4e09fc01eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2903823e-6134-4733-97c8-6a4e09fc01eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a4d96ab8-2072-4eff-b803-53b4f27d056f),volume_id=a4d96ab8-2072-4eff-b803-53b4f27d056f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2b9e36c0-fca3-4234-b65a-a0bb2e61ec78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a4d96ab8-2072-4eff-b803-53b4f27d056f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 104, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 18, 'calculated_free_capacity': 101.0, 'virtual_free_capacity': 101.0, 'free_percent': 84.87, 'provisioned_ratio': 0.15, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/101.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:28:22.454837] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Weigher CapacityWeigher returned, weigher value is {max: 101.0, min: 101.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 19, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 19, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:29:10.250681 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2b9e36c0-fca3-4234-b65a-a0bb2e61ec78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:29:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (2c9835c2-a4ff-4b85-b2cf-1e8041665c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:29:13 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:29:43 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:30:13 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:30:43 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (b9a8db5f-040b-4800-aef0-17a8f3fa730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3e9bcf92-ff22-40fb-8165-28b12090245c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3e9bcf92-ff22-40fb-8165-28b12090245c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(62709a81-268b-4227-ba4a-070034f36414),volume_id=62709a81-268b-4227-ba4a-070034f36414,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d4252708-d38e-4578-b531-3459cf04d47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:30:53 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Error scheduling 62709a81-268b-4227-ba4a-070034f36414 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:29:10.250681 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (62709a81-268b-4227-ba4a-070034f36414) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 104, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 18, 'calculated_free_capacity': 101.0, 'virtual_free_capacity': 101.0, 'free_percent': 84.87, 'provisioned_ratio': 0.15, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/101.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:29:10.250681] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 101.0, min: 101.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 19, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 19, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:30:53.797083 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d4252708-d38e-4578-b531-3459cf04d47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:30:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (b9a8db5f-040b-4800-aef0-17a8f3fa730b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Flow 'volume_create_scheduler' (f3741cfe-6728-41a8-acc5-e36d72c8728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1d5e8823-ee54-4c9a-bc7f-6e35eaf3d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1d5e8823-ee54-4c9a-bc7f-6e35eaf3d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf),volume_id=17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (216e7f00-c97c-4ea3-9917-ae4d13805df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:03 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Error scheduling 17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:30:53.797083 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 104, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 18, 'calculated_free_capacity': 101.0, 'virtual_free_capacity': 101.0, 'free_percent': 84.87, 'provisioned_ratio': 0.15, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/101.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 104, total_capacity_gb: 119, allocated_capacity_gb: 18, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 18, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:30:53.797083] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Weigher CapacityWeigher returned, weigher value is {max: 101.0, min: 101.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 19, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 19, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:03.025320 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (216e7f00-c97c-4ea3-9917-ae4d13805df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Flow 'volume_create_scheduler' (f3741cfe-6728-41a8-acc5-e36d72c8728a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=28,cinder:UPDATE=8 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Flow 'volume_create_scheduler' (2aef8b3b-8886-43aa-9eab-e3e30d28fe06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4f3e87e2-3f71-4596-8379-39ed9518cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4f3e87e2-3f71-4596-8379-39ed9518cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c),volume_id=5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (98cfa93b-f87a-4912-a7c3-39eea42ab3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 103, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 19, 'calculated_free_capacity': 100.0, 'virtual_free_capacity': 100.0, 'free_percent': 84.03, 'provisioned_ratio': 0.16, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/100.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 19, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 19, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:03.025320] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Weigher CapacityWeigher returned, weigher value is {max: 100.0, min: 100.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 20, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 20, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:15.829041 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (98cfa93b-f87a-4912-a7c3-39eea42ab3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Flow 'volume_create_scheduler' (2aef8b3b-8886-43aa-9eab-e3e30d28fe06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (36165e93-8989-4d20-b4ab-03de43a15484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (62fe0172-c536-4bde-b230-6de345433719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (62fe0172-c536-4bde-b230-6de345433719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a4d96ab8-2072-4eff-b803-53b4f27d056f),volume_id=a4d96ab8-2072-4eff-b803-53b4f27d056f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7164a0e2-47ee-48ee-b4b2-4163cad2d668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:27 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Error scheduling a4d96ab8-2072-4eff-b803-53b4f27d056f from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 19, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 19, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:15.829041 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a4d96ab8-2072-4eff-b803-53b4f27d056f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 103, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 19, 'calculated_free_capacity': 100.0, 'virtual_free_capacity': 100.0, 'free_percent': 84.03, 'provisioned_ratio': 0.16, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/100.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 103, total_capacity_gb: 119, allocated_capacity_gb: 19, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 19, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:15.829041] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Weigher CapacityWeigher returned, weigher value is {max: 100.0, min: 100.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 20, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 20, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:27.936711 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7164a0e2-47ee-48ee-b4b2-4163cad2d668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (36165e93-8989-4d20-b4ab-03de43a15484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (13f7734c-b0d7-48c8-80b3-c38b82c7741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (62e857d9-cbd8-41b2-9305-ed0ad0e29d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (62e857d9-cbd8-41b2-9305-ed0ad0e29d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(44f909cf-7774-41f6-9f86-805456609ff8),volume_id=44f909cf-7774-41f6-9f86-805456609ff8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ff438e6f-d064-42bd-bed9-190ba6628658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (44f909cf-7774-41f6-9f86-805456609ff8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 102, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 20, 'calculated_free_capacity': 99.0, 'virtual_free_capacity': 99.0, 'free_percent': 83.19, 'provisioned_ratio': 0.17, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/99.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 102, total_capacity_gb: 119, allocated_capacity_gb: 20, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 20, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:27.936711] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 99.0, min: 99.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 21, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 21, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:28.465067 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ff438e6f-d064-42bd-bed9-190ba6628658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (13f7734c-b0d7-48c8-80b3-c38b82c7741f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (3546c2a7-454b-407e-a855-42694f8db6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b65a51e3-8792-4d68-96df-4ecf4fb664ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b65a51e3-8792-4d68-96df-4ecf4fb664ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0fed6b21-0520-4554-bee4-9540a03f9af0),volume_id=0fed6b21-0520-4554-bee4-9540a03f9af0,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d883a499-90b3-4864-b9b9-3935b849951c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (0fed6b21-0520-4554-bee4-9540a03f9af0) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 101, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 21, 'calculated_free_capacity': 98.0, 'virtual_free_capacity': 98.0, 'free_percent': 82.35, 'provisioned_ratio': 0.18, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/98.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 21, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 21, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:28.465067] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Weigher CapacityWeigher returned, weigher value is {max: 98.0, min: 98.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:41.679753 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d883a499-90b3-4864-b9b9-3935b849951c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:31:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (3546c2a7-454b-407e-a855-42694f8db6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:31:53 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=50,cinder:UPDATE=11 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:32:23 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:32:53 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (a4592c97-4988-4f2e-a04c-04dc6ebea3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d7a35b97-5d35-4f6a-b2dc-57c2f503bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d7a35b97-5d35-4f6a-b2dc-57c2f503bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(62709a81-268b-4227-ba4a-070034f36414),volume_id=62709a81-268b-4227-ba4a-070034f36414,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (417d4fa7-2c01-46fc-9463-6818ac951274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:14 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Error scheduling 62709a81-268b-4227-ba4a-070034f36414 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 21, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 21, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:41.679753 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (62709a81-268b-4227-ba4a-070034f36414) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 101, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 21, 'calculated_free_capacity': 98.0, 'virtual_free_capacity': 98.0, 'free_percent': 82.35, 'provisioned_ratio': 0.18, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/98.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 21, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 21, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:31:41.679753] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 98.0, min: 98.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:33:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:14.972967 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (417d4fa7-2c01-46fc-9463-6818ac951274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (a4592c97-4988-4f2e-a04c-04dc6ebea3ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:23 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Flow 'volume_create_scheduler' (f9a5e34b-51dd-4333-be5d-4b649dfca078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d24fa620-a6e3-47ce-8aed-cde29d596437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d24fa620-a6e3-47ce-8aed-cde29d596437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf),volume_id=17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d5f47def-b486-4ed6-a963-332b29ac8141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:24 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Error scheduling 17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 21, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 21, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:14.972967 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 101, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 21, 'calculated_free_capacity': 98.0, 'virtual_free_capacity': 98.0, 'free_percent': 82.35, 'provisioned_ratio': 0.18, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/98.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 101, total_capacity_gb: 119, allocated_capacity_gb: 21, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 21, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:14.972967] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Weigher CapacityWeigher returned, weigher value is {max: 98.0, min: 98.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:24.188558 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d5f47def-b486-4ed6-a963-332b29ac8141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Flow 'volume_create_scheduler' (f9a5e34b-51dd-4333-be5d-4b649dfca078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (f48bb578-73df-4056-b55f-c22caa444871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c327e67f-a4d3-41f8-a38d-a4bfa14ade1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c327e67f-a4d3-41f8-a38d-a4bfa14ade1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8cc35ab1-363f-4ad6-9a37-239d2b1ea996),volume_id=8cc35ab1-363f-4ad6-9a37-239d2b1ea996,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (63070bf1-0e48-4a1d-821b-e7e691c25e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (8cc35ab1-363f-4ad6-9a37-239d2b1ea996) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 100, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 22, 'calculated_free_capacity': 97.0, 'virtual_free_capacity': 97.0, 'free_percent': 81.51, 'provisioned_ratio': 0.18, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/97.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:24.188558] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Weigher CapacityWeigher returned, weigher value is {max: 97.0, min: 97.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 99, total_capacity_gb: 119, allocated_capacity_gb: 23, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 23, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:30.667873 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (63070bf1-0e48-4a1d-821b-e7e691c25e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (f48bb578-73df-4056-b55f-c22caa444871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Flow 'volume_create_scheduler' (83c8448a-c04d-4d6d-808f-08410bf8c65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e3fd4150-72d8-4e8c-b5c5-7f4b8704b990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e3fd4150-72d8-4e8c-b5c5-7f4b8704b990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c),volume_id=5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c8950774-afea-45f2-b3b1-fe0d4e895107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:36 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Error scheduling 5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:30.667873 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 100, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 22, 'calculated_free_capacity': 97.0, 'virtual_free_capacity': 97.0, 'free_percent': 81.51, 'provisioned_ratio': 0.18, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/97.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:30.667873] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Weigher CapacityWeigher returned, weigher value is {max: 97.0, min: 97.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 99, total_capacity_gb: 119, allocated_capacity_gb: 23, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 23, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:36.481471 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c8950774-afea-45f2-b3b1-fe0d4e895107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Flow 'volume_create_scheduler' (83c8448a-c04d-4d6d-808f-08410bf8c65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (c9a9eaa7-4bd0-44bb-962e-0cfa262677f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5b0c3720-45bf-4b3c-bc13-7465c06d735e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5b0c3720-45bf-4b3c-bc13-7465c06d735e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(44f909cf-7774-41f6-9f86-805456609ff8),volume_id=44f909cf-7774-41f6-9f86-805456609ff8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a79c1048-6262-4daf-a4e0-d5dc12a656d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:48 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Error scheduling 44f909cf-7774-41f6-9f86-805456609ff8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:36.481471 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (44f909cf-7774-41f6-9f86-805456609ff8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 100, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 22, 'calculated_free_capacity': 97.0, 'virtual_free_capacity': 97.0, 'free_percent': 81.51, 'provisioned_ratio': 0.18, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/97.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:36.481471] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 97.0, min: 97.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 99, total_capacity_gb: 119, allocated_capacity_gb: 23, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 23, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:48.861705 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (8d9001d1-8555-4935-b30d-2b72f19b3b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1b8e0fe2-7613-4951-9dbf-d705100322a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1b8e0fe2-7613-4951-9dbf-d705100322a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a4d96ab8-2072-4eff-b803-53b4f27d056f),volume_id=a4d96ab8-2072-4eff-b803-53b4f27d056f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (abf429ae-fa02-4311-bd58-23519a313a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:33:48 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Error scheduling a4d96ab8-2072-4eff-b803-53b4f27d056f from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:48.861705 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a4d96ab8-2072-4eff-b803-53b4f27d056f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 100, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 22, 'calculated_free_capacity': 97.0, 'virtual_free_capacity': 97.0, 'free_percent': 81.51, 'provisioned_ratio': 0.18, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/97.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:48.861705] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Weigher CapacityWeigher returned, weigher value is {max: 97.0, min: 97.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 99, total_capacity_gb: 119, allocated_capacity_gb: 23, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 23, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:48.940385 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a79c1048-6262-4daf-a4e0-d5dc12a656d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (c9a9eaa7-4bd0-44bb-962e-0cfa262677f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (abf429ae-fa02-4311-bd58-23519a313a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:33:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (8d9001d1-8555-4935-b30d-2b72f19b3b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=55,cinder:UPDATE=14 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (3ae3efd1-9e9e-4d49-8d16-46af02aad431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (71d8e224-b59b-4431-8e14-db9385965ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (71d8e224-b59b-4431-8e14-db9385965ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0fed6b21-0520-4554-bee4-9540a03f9af0),volume_id=0fed6b21-0520-4554-bee4-9540a03f9af0,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6e53e891-4948-4bc0-ba15-fb56efc5ced4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:00 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Error scheduling 0fed6b21-0520-4554-bee4-9540a03f9af0 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:48.940385 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (0fed6b21-0520-4554-bee4-9540a03f9af0) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 100, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 22, 'calculated_free_capacity': 97.0, 'virtual_free_capacity': 97.0, 'free_percent': 81.51, 'provisioned_ratio': 0.18, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/97.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 100, total_capacity_gb: 119, allocated_capacity_gb: 22, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 22, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:33:48.940385] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Weigher CapacityWeigher returned, weigher value is {max: 97.0, min: 97.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:34:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 99, total_capacity_gb: 119, allocated_capacity_gb: 23, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 23, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:00.995259 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:34:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6e53e891-4948-4bc0-ba15-fb56efc5ced4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (3ae3efd1-9e9e-4d49-8d16-46af02aad431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Flow 'volume_create_scheduler' (8ea201ff-e382-4acd-af03-eced14bfcc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7591a1e6-48a4-4807-9f48-746806b868af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7591a1e6-48a4-4807-9f48-746806b868af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e80c78b2-20c9-4f9b-8898-6ab131d1eb06),volume_id=e80c78b2-20c9-4f9b-8898-6ab131d1eb06,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c3a66e4f-65bd-4ba3-b295-cab2e19af9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (e80c78b2-20c9-4f9b-8898-6ab131d1eb06) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 99, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 23, 'calculated_free_capacity': 96.0, 'virtual_free_capacity': 96.0, 'free_percent': 80.67, 'provisioned_ratio': 0.19, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/96.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 99, total_capacity_gb: 119, allocated_capacity_gb: 23, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 23, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:00.995259] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Weigher CapacityWeigher returned, weigher value is {max: 96.0, min: 96.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 98, total_capacity_gb: 119, allocated_capacity_gb: 24, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 24, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:16.935946 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c3a66e4f-65bd-4ba3-b295-cab2e19af9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Flow 'volume_create_scheduler' (8ea201ff-e382-4acd-af03-eced14bfcc5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:33 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=28,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Flow 'volume_create_scheduler' (2e01ed3a-b1a2-4767-b1f2-50436dd4b43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fce2f123-d13c-4207-acd6-81bb234cbee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fce2f123-d13c-4207-acd6-81bb234cbee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(29d9e55e-0b8b-4f70-b5c4-830d39f10fcd),volume_id=29d9e55e-0b8b-4f70-b5c4-830d39f10fcd,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a35639dc-23b8-4838-b8df-a505f7d4c372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Checking if host user@joviandss-2#joviandss-2 can create a 2 GB volume (29d9e55e-0b8b-4f70-b5c4-830d39f10fcd) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 98, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 24, 'calculated_free_capacity': 95.0, 'virtual_free_capacity': 95.0, 'free_percent': 79.83, 'provisioned_ratio': 0.2, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 2/95.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 98, total_capacity_gb: 119, allocated_capacity_gb: 24, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 24, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:16.935946] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Weigher CapacityWeigher returned, weigher value is {max: 95.0, min: 95.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Consumed 2 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 96, total_capacity_gb: 119, allocated_capacity_gb: 26, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 26, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:44.570533 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a35639dc-23b8-4838-b8df-a505f7d4c372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Flow 'volume_create_scheduler' (2e01ed3a-b1a2-4767-b1f2-50436dd4b43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (c97d2bd3-e7c7-446c-bad1-1d012ee78857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b950088d-dc10-44da-8ee5-8deaccf4dba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b950088d-dc10-44da-8ee5-8deaccf4dba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(44073502-102d-452a-8244-69a8233b9060),volume_id=44073502-102d-452a-8244-69a8233b9060,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3eafc143-0848-4925-8f41-6049123ff914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (44073502-102d-452a-8244-69a8233b9060) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 96, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 26, 'calculated_free_capacity': 93.0, 'virtual_free_capacity': 93.0, 'free_percent': 78.15, 'provisioned_ratio': 0.22, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/93.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 96, total_capacity_gb: 119, allocated_capacity_gb: 26, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 26, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:44.570533] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 93.0, min: 93.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:45.288558 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3eafc143-0848-4925-8f41-6049123ff914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (c97d2bd3-e7c7-446c-bad1-1d012ee78857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (7d443f32-85d2-4126-9286-4f6d35e53371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dff0a72f-0544-453f-a65d-b1666885d9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dff0a72f-0544-453f-a65d-b1666885d9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(153b4df8-1f37-4118-8aa6-1c155ea5700c),volume_id=153b4df8-1f37-4118-8aa6-1c155ea5700c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d43d2c8b-4ffb-4e01-aed3-6035ed0a0813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (153b4df8-1f37-4118-8aa6-1c155ea5700c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 95, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 27, 'calculated_free_capacity': 92.0, 'virtual_free_capacity': 92.0, 'free_percent': 77.31, 'provisioned_ratio': 0.23, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/92.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:45.288558] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Weigher CapacityWeigher returned, weigher value is {max: 92.0, min: 92.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:57.528040 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d43d2c8b-4ffb-4e01-aed3-6035ed0a0813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:34:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (7d443f32-85d2-4126-9286-4f6d35e53371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:35:03 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=42,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:35:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (e5d9aee0-ecd3-4793-a123-fdb0dd920043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:35:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (428d5936-d285-46b1-8c46-31c49118d0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:35:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (428d5936-d285-46b1-8c46-31c49118d0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(62709a81-268b-4227-ba4a-070034f36414),volume_id=62709a81-268b-4227-ba4a-070034f36414,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:35:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4db33e13-d554-465f-8384-8f841db66d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:35:33 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Error scheduling 62709a81-268b-4227-ba4a-070034f36414 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:35:33 user cinder-scheduler[84081]: INFO cinder.message.api [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Creating message record for request_id = req-e7b5301d-81ea-4ab5-9d69-766347595e11 Apr 17 15:35:33 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:35:33 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 62709a81-268b-4227-ba4a-070034f36414: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 62709a81-268b-4227-ba4a-070034f36414 Apr 17 15:35:33 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Setting Volume 62709a81-268b-4227-ba4a-070034f36414 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 62709a81-268b-4227-ba4a-070034f36414 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:35:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4db33e13-d554-465f-8384-8f841db66d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:35:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e7b5301d-81ea-4ab5-9d69-766347595e11 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (e5d9aee0-ecd3-4793-a123-fdb0dd920043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:35:33 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:35:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Flow 'volume_create_scheduler' (0fc91479-b306-4ca8-99a5-799d7fee2b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:35:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (33581c10-1533-436b-9a56-edea30754c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:35:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (33581c10-1533-436b-9a56-edea30754c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf),volume_id=17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:35:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b7639c89-27a3-4321-b823-961c9312b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:35:43 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Error scheduling 17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:35:43 user cinder-scheduler[84081]: INFO cinder.message.api [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Creating message record for request_id = req-051b1fdc-54da-4587-a61f-deb7faa24c2c Apr 17 15:35:43 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:35:43 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf Apr 17 15:35:43 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Setting Volume 17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 17f8d4f7-2dcd-4041-8d0b-5c8afebb75bf {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:35:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b7639c89-27a3-4321-b823-961c9312b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:35:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-051b1fdc-54da-4587-a61f-deb7faa24c2c tempest-SnapshotMetadataTestJSON-118043004 None] Flow 'volume_create_scheduler' (0fc91479-b306-4ca8-99a5-799d7fee2b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (05e64a67-04e5-4659-8e4c-083608ba3e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4ecef949-88b9-40ef-b8a8-e02867c0b7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4ecef949-88b9-40ef-b8a8-e02867c0b7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8cc35ab1-363f-4ad6-9a37-239d2b1ea996),volume_id=8cc35ab1-363f-4ad6-9a37-239d2b1ea996,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5d85cb1f-e927-433a-ba68-5afa401b1001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:35:52 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Error scheduling 8cc35ab1-363f-4ad6-9a37-239d2b1ea996 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:57.528040 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (8cc35ab1-363f-4ad6-9a37-239d2b1ea996) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 95, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 27, 'calculated_free_capacity': 92.0, 'virtual_free_capacity': 92.0, 'free_percent': 77.31, 'provisioned_ratio': 0.23, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/92.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:34:57.528040] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Weigher CapacityWeigher returned, weigher value is {max: 92.0, min: 92.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:35:52.235709 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5d85cb1f-e927-433a-ba68-5afa401b1001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:35:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (05e64a67-04e5-4659-8e4c-083608ba3e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Flow 'volume_create_scheduler' (8ebd2b34-80e2-4484-b421-86b1a1204c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e395e3bb-3af6-4dfa-895f-106b25e050c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e395e3bb-3af6-4dfa-895f-106b25e050c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c),volume_id=5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d6b1072d-1624-4cd6-a91f-4a54ef3ebbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:35:58 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Error scheduling 5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:35:52.235709 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 95, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 27, 'calculated_free_capacity': 92.0, 'virtual_free_capacity': 92.0, 'free_percent': 77.31, 'provisioned_ratio': 0.23, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/92.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:35:52.235709] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Weigher CapacityWeigher returned, weigher value is {max: 92.0, min: 92.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:35:58.480015 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d6b1072d-1624-4cd6-a91f-4a54ef3ebbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:35:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Flow 'volume_create_scheduler' (8ebd2b34-80e2-4484-b421-86b1a1204c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=33,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (0d3dc539-5114-4b25-9f15-6d683276eff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6b70dce8-9025-468d-bb47-3eef19ab86f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6b70dce8-9025-468d-bb47-3eef19ab86f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a4d96ab8-2072-4eff-b803-53b4f27d056f),volume_id=a4d96ab8-2072-4eff-b803-53b4f27d056f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9e3fbeb1-d122-412e-8ac3-e92514513054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:10 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Error scheduling a4d96ab8-2072-4eff-b803-53b4f27d056f from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:36:10 user cinder-scheduler[84081]: INFO cinder.message.api [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Creating message record for request_id = req-6e1f5cff-98a0-49d3-b32d-29a667939689 Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:36:10 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource a4d96ab8-2072-4eff-b803-53b4f27d056f: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource a4d96ab8-2072-4eff-b803-53b4f27d056f Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Setting Volume a4d96ab8-2072-4eff-b803-53b4f27d056f to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource a4d96ab8-2072-4eff-b803-53b4f27d056f {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (a1d67fb9-bd96-459d-b5f3-e4cbfb912306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8abd2b53-1ca6-4ef5-ad1f-c6bd599bda14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8abd2b53-1ca6-4ef5-ad1f-c6bd599bda14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(44f909cf-7774-41f6-9f86-805456609ff8),volume_id=44f909cf-7774-41f6-9f86-805456609ff8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b88bade-34aa-4f47-a5e8-bc1ee1f3c460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:10 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Error scheduling 44f909cf-7774-41f6-9f86-805456609ff8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:35:58.480015 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9e3fbeb1-d122-412e-8ac3-e92514513054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-6e1f5cff-98a0-49d3-b32d-29a667939689 tempest-VolumesAdminNegativeTest-1285212149 None] Flow 'volume_create_scheduler' (0d3dc539-5114-4b25-9f15-6d683276eff0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (44f909cf-7774-41f6-9f86-805456609ff8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 95, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 27, 'calculated_free_capacity': 92.0, 'virtual_free_capacity': 92.0, 'free_percent': 77.31, 'provisioned_ratio': 0.23, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/92.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:35:58.480015] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 92.0, min: 92.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:36:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:10.992711 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b88bade-34aa-4f47-a5e8-bc1ee1f3c460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (a1d67fb9-bd96-459d-b5f3-e4cbfb912306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (0782f712-eca3-42e9-b306-53c947c577e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ee7e584a-da8c-45a5-aae4-598421c3081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ee7e584a-da8c-45a5-aae4-598421c3081a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0fed6b21-0520-4554-bee4-9540a03f9af0),volume_id=0fed6b21-0520-4554-bee4-9540a03f9af0,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (641c2be2-684d-49ec-9f7e-71c7d918ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:19 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Error scheduling 0fed6b21-0520-4554-bee4-9540a03f9af0 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:36:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:10.992711 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (0fed6b21-0520-4554-bee4-9540a03f9af0) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 95, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 27, 'calculated_free_capacity': 92.0, 'virtual_free_capacity': 92.0, 'free_percent': 77.31, 'provisioned_ratio': 0.23, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/92.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:10.992711] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Weigher CapacityWeigher returned, weigher value is {max: 92.0, min: 92.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:20.013049 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (641c2be2-684d-49ec-9f7e-71c7d918ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (0782f712-eca3-42e9-b306-53c947c577e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=10,cinder:SELECT=32,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Flow 'volume_create_scheduler' (c4922ef8-9ed3-418e-aecb-00de9cca3faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3e77b744-178d-4993-a774-4c499cce5f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3e77b744-178d-4993-a774-4c499cce5f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e80c78b2-20c9-4f9b-8898-6ab131d1eb06),volume_id=e80c78b2-20c9-4f9b-8898-6ab131d1eb06,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fea124e3-1e20-4e3e-9a86-5af98e2d0aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:35 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Error scheduling e80c78b2-20c9-4f9b-8898-6ab131d1eb06 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:20.013049 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (e80c78b2-20c9-4f9b-8898-6ab131d1eb06) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 95, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 27, 'calculated_free_capacity': 92.0, 'virtual_free_capacity': 92.0, 'free_percent': 77.31, 'provisioned_ratio': 0.23, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/92.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:20.013049] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Weigher CapacityWeigher returned, weigher value is {max: 92.0, min: 92.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:35.371295 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fea124e3-1e20-4e3e-9a86-5af98e2d0aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Flow 'volume_create_scheduler' (c4922ef8-9ed3-418e-aecb-00de9cca3faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Flow 'volume_create_scheduler' (7be8bf23-f862-4cb8-9758-d0aab5b6acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ee1e0516-4bf3-4eb1-8562-1e7709e1252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ee1e0516-4bf3-4eb1-8562-1e7709e1252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(29d9e55e-0b8b-4f70-b5c4-830d39f10fcd),volume_id=29d9e55e-0b8b-4f70-b5c4-830d39f10fcd,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7b6a33ea-d902-4201-a096-7d078ee79cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:56 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Error scheduling 29d9e55e-0b8b-4f70-b5c4-830d39f10fcd from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Consumed -2 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 96, total_capacity_gb: 119, allocated_capacity_gb: 26, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 26, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:35.371295 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Checking if host user@joviandss-2#joviandss-2 can create a 2 GB volume (29d9e55e-0b8b-4f70-b5c4-830d39f10fcd) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 96, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 26, 'calculated_free_capacity': 93.0, 'virtual_free_capacity': 93.0, 'free_percent': 78.15, 'provisioned_ratio': 0.22, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 2/93.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 96, total_capacity_gb: 119, allocated_capacity_gb: 26, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 26, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:35.371295] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Weigher CapacityWeigher returned, weigher value is {max: 93.0, min: 93.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Consumed 2 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:56.895977 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7b6a33ea-d902-4201-a096-7d078ee79cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Flow 'volume_create_scheduler' (7be8bf23-f862-4cb8-9758-d0aab5b6acaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (27e05405-9759-41f1-a726-4cbb0194c0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c967a074-c11d-480b-a37d-ca9fe250b2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c967a074-c11d-480b-a37d-ca9fe250b2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(44073502-102d-452a-8244-69a8233b9060),volume_id=44073502-102d-452a-8244-69a8233b9060,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ed21637b-9075-464a-861b-038ac6bc91eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:36:59 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Error scheduling 44073502-102d-452a-8244-69a8233b9060 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:56.895977 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (44073502-102d-452a-8244-69a8233b9060) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 95, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 27, 'calculated_free_capacity': 92.0, 'virtual_free_capacity': 92.0, 'free_percent': 77.31, 'provisioned_ratio': 0.23, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/92.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:56.895977] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 92.0, min: 92.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:59.955551 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ed21637b-9075-464a-861b-038ac6bc91eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:36:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (27e05405-9759-41f1-a726-4cbb0194c0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:37:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=33,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (94a1c954-0b7b-48ac-b077-2b890dadd733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6a42ed72-54c5-45d2-901e-66dafa04c907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6a42ed72-54c5-45d2-901e-66dafa04c907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(153b4df8-1f37-4118-8aa6-1c155ea5700c),volume_id=153b4df8-1f37-4118-8aa6-1c155ea5700c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7f96a11f-f25c-4b26-bd3d-6e3567939fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:37:15 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Error scheduling 153b4df8-1f37-4118-8aa6-1c155ea5700c from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:59.955551 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (153b4df8-1f37-4118-8aa6-1c155ea5700c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 95, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 27, 'calculated_free_capacity': 92.0, 'virtual_free_capacity': 92.0, 'free_percent': 77.31, 'provisioned_ratio': 0.23, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/92.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 95, total_capacity_gb: 119, allocated_capacity_gb: 27, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 27, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:36:59.955551] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Weigher CapacityWeigher returned, weigher value is {max: 92.0, min: 92.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:37:15.366982 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7f96a11f-f25c-4b26-bd3d-6e3567939fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:37:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (94a1c954-0b7b-48ac-b077-2b890dadd733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:37:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Flow 'volume_create_scheduler' (bd8c0e5e-f57d-412d-b252-33538f4b2394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f722750b-12dd-480c-8768-ff458eb8ae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f722750b-12dd-480c-8768-ff458eb8ae92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a50e9659-3e2d-4f04-b0ac-ae78b8f61fad),volume_id=a50e9659-3e2d-4f04-b0ac-ae78b8f61fad,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (103f9a99-421d-4ef8-8b41-60387da0c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a50e9659-3e2d-4f04-b0ac-ae78b8f61fad) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 94, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 28, 'calculated_free_capacity': 91.0, 'virtual_free_capacity': 91.0, 'free_percent': 76.47, 'provisioned_ratio': 0.24, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/91.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 94, total_capacity_gb: 119, allocated_capacity_gb: 28, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 28, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:37:15.366982] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Weigher CapacityWeigher returned, weigher value is {max: 91.0, min: 91.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 93, total_capacity_gb: 119, allocated_capacity_gb: 29, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 29, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:02.168016 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (103f9a99-421d-4ef8-8b41-60387da0c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Flow 'volume_create_scheduler' (bd8c0e5e-f57d-412d-b252-33538f4b2394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (9ac488bb-86e4-4eb3-acab-c251fd6b9508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (153ecb73-9a19-4186-b575-958ac2e87563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (153ecb73-9a19-4186-b575-958ac2e87563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(57070f23-6b40-47b9-b9b4-e0d77240f544),volume_id=57070f23-6b40-47b9-b9b4-e0d77240f544,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5bad2552-a9d1-48e9-a541-b88b4ad74fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (57070f23-6b40-47b9-b9b4-e0d77240f544) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 93, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 29, 'calculated_free_capacity': 90.0, 'virtual_free_capacity': 90.0, 'free_percent': 75.63, 'provisioned_ratio': 0.24, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/90.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 93, total_capacity_gb: 119, allocated_capacity_gb: 29, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 29, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:02.168016] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 90.0, min: 90.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 92, total_capacity_gb: 119, allocated_capacity_gb: 30, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 30, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:02.306018 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5bad2552-a9d1-48e9-a541-b88b4ad74fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (9ac488bb-86e4-4eb3-acab-c251fd6b9508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (3e900c7c-7c48-4921-915d-aa66c51ca1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (af01f0dc-fb60-428b-9658-3d8dea67f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (af01f0dc-fb60-428b-9658-3d8dea67f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8cc35ab1-363f-4ad6-9a37-239d2b1ea996),volume_id=8cc35ab1-363f-4ad6-9a37-239d2b1ea996,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (023fe8dd-53b0-418e-bc09-a510af55e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:11 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Error scheduling 8cc35ab1-363f-4ad6-9a37-239d2b1ea996 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 93, total_capacity_gb: 119, allocated_capacity_gb: 29, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 29, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:02.306018 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (8cc35ab1-363f-4ad6-9a37-239d2b1ea996) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 93, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 29, 'calculated_free_capacity': 90.0, 'virtual_free_capacity': 90.0, 'free_percent': 75.63, 'provisioned_ratio': 0.24, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/90.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 93, total_capacity_gb: 119, allocated_capacity_gb: 29, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 29, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:02.306018] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Weigher CapacityWeigher returned, weigher value is {max: 90.0, min: 90.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 92, total_capacity_gb: 119, allocated_capacity_gb: 30, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 30, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:11.522984 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (023fe8dd-53b0-418e-bc09-a510af55e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (3e900c7c-7c48-4921-915d-aa66c51ca1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=41,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Flow 'volume_create_scheduler' (2617ef42-b73a-4294-9450-3b01ad232566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83acd022-84d6-48e9-a2dc-aa397a1f53fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83acd022-84d6-48e9-a2dc-aa397a1f53fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7ce815ce-9603-4fd6-8cc8-9fd798b2f99d),volume_id=7ce815ce-9603-4fd6-8cc8-9fd798b2f99d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9dc2caee-eba6-4133-97e4-c9bb2f90e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7ce815ce-9603-4fd6-8cc8-9fd798b2f99d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 92, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 30, 'calculated_free_capacity': 89.0, 'virtual_free_capacity': 89.0, 'free_percent': 74.79, 'provisioned_ratio': 0.25, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/89.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 92, total_capacity_gb: 119, allocated_capacity_gb: 30, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 30, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:11.522984] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Weigher CapacityWeigher returned, weigher value is {max: 89.0, min: 89.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:16.835289 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9dc2caee-eba6-4133-97e4-c9bb2f90e34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Flow 'volume_create_scheduler' (2617ef42-b73a-4294-9450-3b01ad232566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Flow 'volume_create_scheduler' (09788372-7b39-4fa7-9559-79d7792221d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (84f635e5-d146-4926-8258-32ccb6a2a6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (84f635e5-d146-4926-8258-32ccb6a2a6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c),volume_id=5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d9892c66-bfe7-47c9-b28b-37e34ce51a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:17 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Error scheduling 5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:38:17 user cinder-scheduler[84081]: INFO cinder.message.api [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Creating message record for request_id = req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 Apr 17 15:38:17 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:38:17 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c Apr 17 15:38:17 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Setting Volume 5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 5d9c86cd-3e22-4926-bfc9-e5a37f6ae76c {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:38:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d9892c66-bfe7-47c9-b28b-37e34ce51a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a9831ecf-bf39-4cfe-ae2d-314dbfb31318 tempest-VolumesServicesTestJSON-1183731809 None] Flow 'volume_create_scheduler' (09788372-7b39-4fa7-9559-79d7792221d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (b6245d5a-fc7f-498f-bda9-784a79ff54f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7f1c5920-6354-4bd4-ac11-5a77b95626b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7f1c5920-6354-4bd4-ac11-5a77b95626b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(44f909cf-7774-41f6-9f86-805456609ff8),volume_id=44f909cf-7774-41f6-9f86-805456609ff8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3c354e56-81a3-4e46-b68c-7b73d8bcceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:29 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Error scheduling 44f909cf-7774-41f6-9f86-805456609ff8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:38:29 user cinder-scheduler[84081]: INFO cinder.message.api [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Creating message record for request_id = req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df Apr 17 15:38:30 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:38:30 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 44f909cf-7774-41f6-9f86-805456609ff8: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 44f909cf-7774-41f6-9f86-805456609ff8 Apr 17 15:38:30 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Setting Volume 44f909cf-7774-41f6-9f86-805456609ff8 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 44f909cf-7774-41f6-9f86-805456609ff8 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:38:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3c354e56-81a3-4e46-b68c-7b73d8bcceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9c9edd59-8934-430a-a1fa-77dd5ef4d4df tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (b6245d5a-fc7f-498f-bda9-784a79ff54f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (cd868da0-7edd-4a8e-aaf7-f09dac726ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6a960039-9727-42f2-beae-02abbc9f0907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6a960039-9727-42f2-beae-02abbc9f0907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0fed6b21-0520-4554-bee4-9540a03f9af0),volume_id=0fed6b21-0520-4554-bee4-9540a03f9af0,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5e7a539b-7b33-4756-ac59-6d4441ae7097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:39 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Error scheduling 0fed6b21-0520-4554-bee4-9540a03f9af0 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:38:39 user cinder-scheduler[84081]: INFO cinder.message.api [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Creating message record for request_id = req-d0269988-5f86-4167-b5dd-78432d84593a Apr 17 15:38:39 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:38:39 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 0fed6b21-0520-4554-bee4-9540a03f9af0: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 0fed6b21-0520-4554-bee4-9540a03f9af0 Apr 17 15:38:39 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Setting Volume 0fed6b21-0520-4554-bee4-9540a03f9af0 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 0fed6b21-0520-4554-bee4-9540a03f9af0 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:38:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5e7a539b-7b33-4756-ac59-6d4441ae7097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d0269988-5f86-4167-b5dd-78432d84593a tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (cd868da0-7edd-4a8e-aaf7-f09dac726ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=12,cinder:SELECT=39,cinder:INSERT=3,cinder:DELETE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (69685012-c894-4c9e-b503-70b94eb7d6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a10c4e4f-3a57-4a73-a0fd-74a385f2cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a10c4e4f-3a57-4a73-a0fd-74a385f2cc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a27d0ff3-5de9-4feb-82f7-d4571af88bb9),volume_id=a27d0ff3-5de9-4feb-82f7-d4571af88bb9,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fcdd8e06-3bc2-4984-bc4b-3c6724899f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a27d0ff3-5de9-4feb-82f7-d4571af88bb9) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 91, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 31, 'calculated_free_capacity': 88.0, 'virtual_free_capacity': 88.0, 'free_percent': 73.95, 'provisioned_ratio': 0.26, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/88.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:16.835289] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Weigher CapacityWeigher returned, weigher value is {max: 88.0, min: 88.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:47.223047 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fcdd8e06-3bc2-4984-bc4b-3c6724899f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (69685012-c894-4c9e-b503-70b94eb7d6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Flow 'volume_create_scheduler' (259fa682-458d-49e7-959c-7c7fb66688db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (26135bdf-1391-45fd-bc53-e91d105b1d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (26135bdf-1391-45fd-bc53-e91d105b1d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e80c78b2-20c9-4f9b-8898-6ab131d1eb06),volume_id=e80c78b2-20c9-4f9b-8898-6ab131d1eb06,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ba169a70-9dfd-4079-8f3f-7869527d4e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:38:54 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Error scheduling e80c78b2-20c9-4f9b-8898-6ab131d1eb06 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:47.223047 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (e80c78b2-20c9-4f9b-8898-6ab131d1eb06) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 91, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 31, 'calculated_free_capacity': 88.0, 'virtual_free_capacity': 88.0, 'free_percent': 73.95, 'provisioned_ratio': 0.26, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/88.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:47.223047] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Weigher CapacityWeigher returned, weigher value is {max: 88.0, min: 88.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:54.524315 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ba169a70-9dfd-4079-8f3f-7869527d4e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:38:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Flow 'volume_create_scheduler' (259fa682-458d-49e7-959c-7c7fb66688db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Flow 'volume_create_scheduler' (31edffd7-4f1d-4c30-85f5-6e48450f20f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c3be7123-e3d3-4f8e-b33d-2ca26a2a58df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c3be7123-e3d3-4f8e-b33d-2ca26a2a58df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(29d9e55e-0b8b-4f70-b5c4-830d39f10fcd),volume_id=29d9e55e-0b8b-4f70-b5c4-830d39f10fcd,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (27fc140e-9fd4-49f7-a98d-58a9c3f3eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:39:16 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Error scheduling 29d9e55e-0b8b-4f70-b5c4-830d39f10fcd from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Consumed -2 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 92, total_capacity_gb: 119, allocated_capacity_gb: 30, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 30, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:54.524315 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Checking if host user@joviandss-2#joviandss-2 can create a 2 GB volume (29d9e55e-0b8b-4f70-b5c4-830d39f10fcd) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 92, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 30, 'calculated_free_capacity': 89.0, 'virtual_free_capacity': 89.0, 'free_percent': 74.79, 'provisioned_ratio': 0.25, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 2/89.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 92, total_capacity_gb: 119, allocated_capacity_gb: 30, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 30, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:38:54.524315] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Weigher CapacityWeigher returned, weigher value is {max: 89.0, min: 89.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Consumed 2 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:39:16.195045 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (27fc140e-9fd4-49f7-a98d-58a9c3f3eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:39:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Flow 'volume_create_scheduler' (31edffd7-4f1d-4c30-85f5-6e48450f20f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=36,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (2d7cc481-e3f5-4563-bcab-6ae1220f552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (498817ce-9d4e-43de-91a1-673948a45712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (498817ce-9d4e-43de-91a1-673948a45712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(44073502-102d-452a-8244-69a8233b9060),volume_id=44073502-102d-452a-8244-69a8233b9060,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (30db5f17-abc7-402f-9f95-e46257c051c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:39:19 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Error scheduling 44073502-102d-452a-8244-69a8233b9060 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:39:16.195045 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (44073502-102d-452a-8244-69a8233b9060) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 91, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 31, 'calculated_free_capacity': 88.0, 'virtual_free_capacity': 88.0, 'free_percent': 73.95, 'provisioned_ratio': 0.26, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/88.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:39:16.195045] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 88.0, min: 88.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:39:19.275740 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (30db5f17-abc7-402f-9f95-e46257c051c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:39:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (2d7cc481-e3f5-4563-bcab-6ae1220f552a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (a3f20c06-44a6-4852-9b42-413f70a85faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f7009199-c415-4106-b0cc-b5a4a9e2569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f7009199-c415-4106-b0cc-b5a4a9e2569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(153b4df8-1f37-4118-8aa6-1c155ea5700c),volume_id=153b4df8-1f37-4118-8aa6-1c155ea5700c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3bd9c55d-3940-4bd2-a298-a8bfbcbc2c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:39:31 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Error scheduling 153b4df8-1f37-4118-8aa6-1c155ea5700c from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:39:19.275740 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (153b4df8-1f37-4118-8aa6-1c155ea5700c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 91, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 31, 'calculated_free_capacity': 88.0, 'virtual_free_capacity': 88.0, 'free_percent': 73.95, 'provisioned_ratio': 0.26, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/88.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:39:19.275740] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Weigher CapacityWeigher returned, weigher value is {max: 88.0, min: 88.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:39:31.610531 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3bd9c55d-3940-4bd2-a298-a8bfbcbc2c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:39:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (a3f20c06-44a6-4852-9b42-413f70a85faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:39:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=25,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Flow 'volume_create_scheduler' (8a16107a-beda-40b9-ac12-42638999b927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ce1afb83-7607-4ac9-9d9b-915d33aae0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ce1afb83-7607-4ac9-9d9b-915d33aae0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a50e9659-3e2d-4f04-b0ac-ae78b8f61fad),volume_id=a50e9659-3e2d-4f04-b0ac-ae78b8f61fad,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bff7ee8a-fb91-414a-bf13-041d98079e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:40:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Error scheduling a50e9659-3e2d-4f04-b0ac-ae78b8f61fad from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:39:31.610531 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a50e9659-3e2d-4f04-b0ac-ae78b8f61fad) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 91, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 31, 'calculated_free_capacity': 88.0, 'virtual_free_capacity': 88.0, 'free_percent': 73.95, 'provisioned_ratio': 0.26, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/88.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:39:31.610531] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Weigher CapacityWeigher returned, weigher value is {max: 88.0, min: 88.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:40:21.387968 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (e57aeca8-1ed1-458d-ac4c-ae4ae9177e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (354c55f9-6a47-4718-8708-d7c16f5bfde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (354c55f9-6a47-4718-8708-d7c16f5bfde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(57070f23-6b40-47b9-b9b4-e0d77240f544),volume_id=57070f23-6b40-47b9-b9b4-e0d77240f544,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (886e565d-f742-45d2-9898-127102db070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:40:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Error scheduling 57070f23-6b40-47b9-b9b4-e0d77240f544 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:40:21.387968 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bff7ee8a-fb91-414a-bf13-041d98079e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Flow 'volume_create_scheduler' (8a16107a-beda-40b9-ac12-42638999b927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (57070f23-6b40-47b9-b9b4-e0d77240f544) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 91, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 31, 'calculated_free_capacity': 88.0, 'virtual_free_capacity': 88.0, 'free_percent': 73.95, 'provisioned_ratio': 0.26, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/88.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:40:21.387968] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 88.0, min: 88.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:40:21.463733 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (886e565d-f742-45d2-9898-127102db070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:40:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (e57aeca8-1ed1-458d-ac4c-ae4ae9177e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:40:30 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=28,cinder:UPDATE=8 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:40:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (27cc4268-eeb8-42c8-abbd-de985dcf3ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:40:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a83a22b-69bf-4b79-8596-b41b123bf6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:40:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a83a22b-69bf-4b79-8596-b41b123bf6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8cc35ab1-363f-4ad6-9a37-239d2b1ea996),volume_id=8cc35ab1-363f-4ad6-9a37-239d2b1ea996,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:40:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7068a5c4-70ee-4153-b7db-724a4edf01e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:40:30 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Error scheduling 8cc35ab1-363f-4ad6-9a37-239d2b1ea996 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:40:30 user cinder-scheduler[84081]: INFO cinder.message.api [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Creating message record for request_id = req-822bc81b-4af7-4475-af70-370e1870fe50 Apr 17 15:40:30 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:40:30 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 8cc35ab1-363f-4ad6-9a37-239d2b1ea996: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 8cc35ab1-363f-4ad6-9a37-239d2b1ea996 Apr 17 15:40:30 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Setting Volume 8cc35ab1-363f-4ad6-9a37-239d2b1ea996 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 8cc35ab1-363f-4ad6-9a37-239d2b1ea996 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:40:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7068a5c4-70ee-4153-b7db-724a4edf01e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:40:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-822bc81b-4af7-4475-af70-370e1870fe50 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (27cc4268-eeb8-42c8-abbd-de985dcf3ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Flow 'volume_create_scheduler' (178293d1-f692-4d06-8020-b336e1052c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (496a4c67-bb8d-4a17-ab92-d626ac86f1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (496a4c67-bb8d-4a17-ab92-d626ac86f1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7ce815ce-9603-4fd6-8cc8-9fd798b2f99d),volume_id=7ce815ce-9603-4fd6-8cc8-9fd798b2f99d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (afadee73-5317-4701-902b-c9a9c1d1c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:40:33 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Error scheduling 7ce815ce-9603-4fd6-8cc8-9fd798b2f99d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:40:21.463733 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7ce815ce-9603-4fd6-8cc8-9fd798b2f99d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 91, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 31, 'calculated_free_capacity': 88.0, 'virtual_free_capacity': 88.0, 'free_percent': 73.95, 'provisioned_ratio': 0.26, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/88.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:40:21.463733] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Weigher CapacityWeigher returned, weigher value is {max: 88.0, min: 88.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:40:33.596684 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (afadee73-5317-4701-902b-c9a9c1d1c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:40:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Flow 'volume_create_scheduler' (178293d1-f692-4d06-8020-b336e1052c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=23,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (ddab11b4-8d92-4e43-b705-2772f916868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2f7a2732-0150-439e-a9bf-28db6e071461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2f7a2732-0150-439e-a9bf-28db6e071461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a27d0ff3-5de9-4feb-82f7-d4571af88bb9),volume_id=a27d0ff3-5de9-4feb-82f7-d4571af88bb9,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e00d8515-cf61-4386-9695-f830f23ee9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:04 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Error scheduling a27d0ff3-5de9-4feb-82f7-d4571af88bb9 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:40:33.596684 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a27d0ff3-5de9-4feb-82f7-d4571af88bb9) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 91, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 31, 'calculated_free_capacity': 88.0, 'virtual_free_capacity': 88.0, 'free_percent': 73.95, 'provisioned_ratio': 0.26, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/88.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 91, total_capacity_gb: 119, allocated_capacity_gb: 31, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 31, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:40:33.596684] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Weigher CapacityWeigher returned, weigher value is {max: 88.0, min: 88.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:41:04.316880 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e00d8515-cf61-4386-9695-f830f23ee9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (ddab11b4-8d92-4e43-b705-2772f916868d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Flow 'volume_create_scheduler' (3b4bce90-30d0-40e1-9494-2c0920cdeecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (49a4bd95-1748-4a54-8189-5cf3a6c53cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (49a4bd95-1748-4a54-8189-5cf3a6c53cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e80c78b2-20c9-4f9b-8898-6ab131d1eb06),volume_id=e80c78b2-20c9-4f9b-8898-6ab131d1eb06,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ebe26725-9675-4ecb-a140-e7657c926e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:13 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Error scheduling e80c78b2-20c9-4f9b-8898-6ab131d1eb06 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:41:13 user cinder-scheduler[84081]: INFO cinder.message.api [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Creating message record for request_id = req-31dc7151-4287-4070-a9f9-0abbb6a67df4 Apr 17 15:41:13 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:41:13 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource e80c78b2-20c9-4f9b-8898-6ab131d1eb06: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource e80c78b2-20c9-4f9b-8898-6ab131d1eb06 Apr 17 15:41:13 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Setting Volume e80c78b2-20c9-4f9b-8898-6ab131d1eb06 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource e80c78b2-20c9-4f9b-8898-6ab131d1eb06 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:41:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ebe26725-9675-4ecb-a140-e7657c926e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-31dc7151-4287-4070-a9f9-0abbb6a67df4 tempest-TaggedBootDevicesTest-809025791 None] Flow 'volume_create_scheduler' (3b4bce90-30d0-40e1-9494-2c0920cdeecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (87f11ad0-2a44-4e43-a691-e5680caeff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0fa6dd18-b7fb-4750-8714-6bcb95ff0eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0fa6dd18-b7fb-4750-8714-6bcb95ff0eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(441910f8-d29c-4c9e-bc5b-780ad228c85d),volume_id=441910f8-d29c-4c9e-bc5b-780ad228c85d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e2856c48-b17b-4c9b-82d1-9da8dc73a355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (441910f8-d29c-4c9e-bc5b-780ad228c85d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 90, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 32, 'calculated_free_capacity': 87.0, 'virtual_free_capacity': 87.0, 'free_percent': 73.11, 'provisioned_ratio': 0.27, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/87.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:41:04.316880] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 87.0, min: 87.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 89, total_capacity_gb: 119, allocated_capacity_gb: 33, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 33, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:41:18.608120 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e2856c48-b17b-4c9b-82d1-9da8dc73a355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (87f11ad0-2a44-4e43-a691-e5680caeff48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:35 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=37,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:41:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Flow 'volume_create_scheduler' (ee84787e-1cf1-4586-a33e-2c489c7bdff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d2f4bd61-19a9-4a74-94b8-8affa43385d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d2f4bd61-19a9-4a74-94b8-8affa43385d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(29d9e55e-0b8b-4f70-b5c4-830d39f10fcd),volume_id=29d9e55e-0b8b-4f70-b5c4-830d39f10fcd,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ea462711-08f8-4cb0-b847-e58d2c5d84c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:35 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Error scheduling 29d9e55e-0b8b-4f70-b5c4-830d39f10fcd from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:41:35 user cinder-scheduler[84081]: INFO cinder.message.api [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Creating message record for request_id = req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 Apr 17 15:41:35 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:41:35 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 29d9e55e-0b8b-4f70-b5c4-830d39f10fcd: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 29d9e55e-0b8b-4f70-b5c4-830d39f10fcd Apr 17 15:41:35 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Setting Volume 29d9e55e-0b8b-4f70-b5c4-830d39f10fcd to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 29d9e55e-0b8b-4f70-b5c4-830d39f10fcd {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:41:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ea462711-08f8-4cb0-b847-e58d2c5d84c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-60e7b05f-e229-45c2-a0b3-cd53ab13bb63 tempest-VolumesSnapshotNegativeTestJSON-225666610 None] Flow 'volume_create_scheduler' (ee84787e-1cf1-4586-a33e-2c489c7bdff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (ea47cdef-d22c-46e8-b39d-9e8f2224b652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (af595b21-01c3-42a1-b5f1-9c08991c948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (af595b21-01c3-42a1-b5f1-9c08991c948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(44073502-102d-452a-8244-69a8233b9060),volume_id=44073502-102d-452a-8244-69a8233b9060,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (73a006d1-5063-4587-bf20-b26cd7fc2a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:38 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Error scheduling 44073502-102d-452a-8244-69a8233b9060 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:41:38 user cinder-scheduler[84081]: INFO cinder.message.api [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Creating message record for request_id = req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 Apr 17 15:41:38 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:41:38 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 44073502-102d-452a-8244-69a8233b9060: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 44073502-102d-452a-8244-69a8233b9060 Apr 17 15:41:38 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Setting Volume 44073502-102d-452a-8244-69a8233b9060 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 44073502-102d-452a-8244-69a8233b9060 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:41:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (73a006d1-5063-4587-bf20-b26cd7fc2a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ec7f2ef2-a4da-41de-8aa1-8396b20368a6 tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (ea47cdef-d22c-46e8-b39d-9e8f2224b652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (aedc6ffc-673e-4c8e-944d-96218be36cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:41:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (88f57560-001d-44fa-a0f7-fd86e55c9e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (88f57560-001d-44fa-a0f7-fd86e55c9e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(153b4df8-1f37-4118-8aa6-1c155ea5700c),volume_id=153b4df8-1f37-4118-8aa6-1c155ea5700c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ff4da29b-b2d5-449b-b62b-f16c911829cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:41:50 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Error scheduling 153b4df8-1f37-4118-8aa6-1c155ea5700c from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:41:50 user cinder-scheduler[84081]: INFO cinder.message.api [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Creating message record for request_id = req-de22aca9-c3f8-4015-be3e-9d70b59359d2 Apr 17 15:41:50 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:41:50 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 153b4df8-1f37-4118-8aa6-1c155ea5700c: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 153b4df8-1f37-4118-8aa6-1c155ea5700c Apr 17 15:41:50 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Setting Volume 153b4df8-1f37-4118-8aa6-1c155ea5700c to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 153b4df8-1f37-4118-8aa6-1c155ea5700c {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:41:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ff4da29b-b2d5-449b-b62b-f16c911829cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:41:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-de22aca9-c3f8-4015-be3e-9d70b59359d2 tempest-VolumesCloneTest-1847825601 None] Flow 'volume_create_scheduler' (aedc6ffc-673e-4c8e-944d-96218be36cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:42:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=27,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (ee5ad8b2-b25f-4f38-a790-d61562edbd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (63e0c145-6272-4e16-85cd-d46657e9a519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (63e0c145-6272-4e16-85cd-d46657e9a519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(57070f23-6b40-47b9-b9b4-e0d77240f544),volume_id=57070f23-6b40-47b9-b9b4-e0d77240f544,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8fe630e9-6e46-4863-8734-c20046dbcfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:42:40 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Error scheduling 57070f23-6b40-47b9-b9b4-e0d77240f544 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:41:18.608120 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (57070f23-6b40-47b9-b9b4-e0d77240f544) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 90, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 32, 'calculated_free_capacity': 87.0, 'virtual_free_capacity': 87.0, 'free_percent': 73.11, 'provisioned_ratio': 0.27, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/87.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:41:18.608120] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 87.0, min: 87.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 89, total_capacity_gb: 119, allocated_capacity_gb: 33, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 33, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:42:40.655864 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Flow 'volume_create_scheduler' (15466ac9-6916-4bac-b4e2-c2a869797d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (891845b4-876f-4367-99a9-4dbc22af48db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (891845b4-876f-4367-99a9-4dbc22af48db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a50e9659-3e2d-4f04-b0ac-ae78b8f61fad),volume_id=a50e9659-3e2d-4f04-b0ac-ae78b8f61fad,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3e2b1c4a-3d68-415e-b714-c2f1b80de112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:42:40 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Error scheduling a50e9659-3e2d-4f04-b0ac-ae78b8f61fad from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:42:40.655864 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a50e9659-3e2d-4f04-b0ac-ae78b8f61fad) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 90, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 32, 'calculated_free_capacity': 87.0, 'virtual_free_capacity': 87.0, 'free_percent': 73.11, 'provisioned_ratio': 0.27, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/87.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:42:40.655864] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Weigher CapacityWeigher returned, weigher value is {max: 87.0, min: 87.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 89, total_capacity_gb: 119, allocated_capacity_gb: 33, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 33, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:42:40.715525 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8fe630e9-6e46-4863-8734-c20046dbcfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (ee5ad8b2-b25f-4f38-a790-d61562edbd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3e2b1c4a-3d68-415e-b714-c2f1b80de112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:42:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Flow 'volume_create_scheduler' (15466ac9-6916-4bac-b4e2-c2a869797d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=28,cinder:UPDATE=8 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Flow 'volume_create_scheduler' (d3feaf84-b3db-4e69-a0cd-ba0a64f82d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (30e63440-6fb1-4acb-9d0f-a1a22d427c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (30e63440-6fb1-4acb-9d0f-a1a22d427c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7ce815ce-9603-4fd6-8cc8-9fd798b2f99d),volume_id=7ce815ce-9603-4fd6-8cc8-9fd798b2f99d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (db4c6f54-c5d9-4acf-a169-f57d0e4bdd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:42:52 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Error scheduling 7ce815ce-9603-4fd6-8cc8-9fd798b2f99d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:42:40.715525 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7ce815ce-9603-4fd6-8cc8-9fd798b2f99d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 90, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 32, 'calculated_free_capacity': 87.0, 'virtual_free_capacity': 87.0, 'free_percent': 73.11, 'provisioned_ratio': 0.27, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/87.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:42:40.715525] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Weigher CapacityWeigher returned, weigher value is {max: 87.0, min: 87.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 89, total_capacity_gb: 119, allocated_capacity_gb: 33, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 33, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:42:52.825098 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (db4c6f54-c5d9-4acf-a169-f57d0e4bdd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:42:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Flow 'volume_create_scheduler' (d3feaf84-b3db-4e69-a0cd-ba0a64f82d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (823fe1bb-92c8-4e53-8e5b-e50415ee40d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (11643c7a-1d46-4cf4-bc55-0fb5731366e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (11643c7a-1d46-4cf4-bc55-0fb5731366e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a27d0ff3-5de9-4feb-82f7-d4571af88bb9),volume_id=a27d0ff3-5de9-4feb-82f7-d4571af88bb9,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7d414ae4-62de-4c11-8d81-f45e01792fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:43:24 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Error scheduling a27d0ff3-5de9-4feb-82f7-d4571af88bb9 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:42:52.825098 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (a27d0ff3-5de9-4feb-82f7-d4571af88bb9) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 90, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 32, 'calculated_free_capacity': 87.0, 'virtual_free_capacity': 87.0, 'free_percent': 73.11, 'provisioned_ratio': 0.27, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/87.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:42:52.825098] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Weigher CapacityWeigher returned, weigher value is {max: 87.0, min: 87.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 89, total_capacity_gb: 119, allocated_capacity_gb: 33, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 33, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:43:24.180157 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7d414ae4-62de-4c11-8d81-f45e01792fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:43:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (823fe1bb-92c8-4e53-8e5b-e50415ee40d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (b75da167-e1e0-406c-8ac5-7bf54cffec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (aad797de-40be-4c94-a6da-ab9a7ab56405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (aad797de-40be-4c94-a6da-ab9a7ab56405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(441910f8-d29c-4c9e-bc5b-780ad228c85d),volume_id=441910f8-d29c-4c9e-bc5b-780ad228c85d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fc09974b-ec6c-4aeb-a176-ecb7c5838b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:43:36 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Error scheduling 441910f8-d29c-4c9e-bc5b-780ad228c85d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:43:24.180157 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (441910f8-d29c-4c9e-bc5b-780ad228c85d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 90, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 32, 'calculated_free_capacity': 87.0, 'virtual_free_capacity': 87.0, 'free_percent': 73.11, 'provisioned_ratio': 0.27, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/87.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 90, total_capacity_gb: 119, allocated_capacity_gb: 32, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 32, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:43:24.180157] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 87.0, min: 87.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 89, total_capacity_gb: 119, allocated_capacity_gb: 33, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 33, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:43:36.438257 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fc09974b-ec6c-4aeb-a176-ecb7c5838b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:43:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (b75da167-e1e0-406c-8ac5-7bf54cffec1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (62e52661-4422-43af-a155-deaba18c370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8ac58683-94e1-44b7-a202-ab55068a0953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8ac58683-94e1-44b7-a202-ab55068a0953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5c16bb82-43c5-4d91-9320-0e1f2bbec574),volume_id=5c16bb82-43c5-4d91-9320-0e1f2bbec574,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (46e409f4-57e8-41cf-bdc8-4e0cc8dc7951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (5c16bb82-43c5-4d91-9320-0e1f2bbec574) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 89, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 33, 'calculated_free_capacity': 86.0, 'virtual_free_capacity': 86.0, 'free_percent': 72.27, 'provisioned_ratio': 0.28, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/86.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 89, total_capacity_gb: 119, allocated_capacity_gb: 33, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 33, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:43:36.438257] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Weigher CapacityWeigher returned, weigher value is {max: 86.0, min: 86.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 88, total_capacity_gb: 119, allocated_capacity_gb: 34, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 34, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:43:43.309213 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (46e409f4-57e8-41cf-bdc8-4e0cc8dc7951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:43:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (62e52661-4422-43af-a155-deaba18c370a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=39,cinder:UPDATE=10 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (228cc317-e622-4b2d-89fc-c9e7a4015355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a39015e9-5831-4481-805e-eea2b7229c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a39015e9-5831-4481-805e-eea2b7229c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2c9714de-f8ea-4d1d-99f9-beb85126ad91),volume_id=2c9714de-f8ea-4d1d-99f9-beb85126ad91,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1dee77d9-152d-4c4f-8b67-42125efc5efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2c9714de-f8ea-4d1d-99f9-beb85126ad91) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 88, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 34, 'calculated_free_capacity': 85.0, 'virtual_free_capacity': 85.0, 'free_percent': 71.43, 'provisioned_ratio': 0.29, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/85.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 88, total_capacity_gb: 119, allocated_capacity_gb: 34, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 34, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:43:43.309213] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weigher CapacityWeigher returned, weigher value is {max: 85.0, min: 85.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 87, total_capacity_gb: 119, allocated_capacity_gb: 35, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 35, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:02.849902 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1dee77d9-152d-4c4f-8b67-42125efc5efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (228cc317-e622-4b2d-89fc-c9e7a4015355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (674ce6ea-5228-423b-9131-b7431d3a6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ea1fe664-1760-4e8f-95a8-dbf8a70e0d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ea1fe664-1760-4e8f-95a8-dbf8a70e0d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(dfd745ed-b0c4-4e35-b77c-a911c90ce33e),volume_id=dfd745ed-b0c4-4e35-b77c-a911c90ce33e,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0603694e-03ad-47fb-b9a2-1f2f933ad9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (dfd745ed-b0c4-4e35-b77c-a911c90ce33e) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 87, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 35, 'calculated_free_capacity': 84.0, 'virtual_free_capacity': 84.0, 'free_percent': 70.59, 'provisioned_ratio': 0.29, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/84.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 87, total_capacity_gb: 119, allocated_capacity_gb: 35, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 35, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:02.849902] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 84.0, min: 84.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 86, total_capacity_gb: 119, allocated_capacity_gb: 36, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 36, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:38.606560 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0603694e-03ad-47fb-b9a2-1f2f933ad9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (674ce6ea-5228-423b-9131-b7431d3a6832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (769414ac-0a80-4cd4-a705-e58d394e63b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ac5db6ca-d127-432c-afe5-261fcf1ad36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ac5db6ca-d127-432c-afe5-261fcf1ad36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(aea45c70-7c05-4146-847e-cbb777d3dfbe),volume_id=aea45c70-7c05-4146-847e-cbb777d3dfbe,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a93a8f58-ca2a-4dca-a568-c30b8a7cd901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (aea45c70-7c05-4146-847e-cbb777d3dfbe) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 86, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 36, 'calculated_free_capacity': 83.0, 'virtual_free_capacity': 83.0, 'free_percent': 69.75, 'provisioned_ratio': 0.3, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/83.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 86, total_capacity_gb: 119, allocated_capacity_gb: 36, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 36, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:38.606560] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 83.0, min: 83.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 85, total_capacity_gb: 119, allocated_capacity_gb: 37, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 37, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:38.834141 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a93a8f58-ca2a-4dca-a568-c30b8a7cd901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (769414ac-0a80-4cd4-a705-e58d394e63b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (8ce772d8-36d6-4e48-925e-0de956264647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1c70a8a6-a736-49d1-b2ad-e3b00e14d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1c70a8a6-a736-49d1-b2ad-e3b00e14d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fbbadf16-651a-47d5-b308-a37e56aa07f2),volume_id=fbbadf16-651a-47d5-b308-a37e56aa07f2,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (612cad3a-1344-4cd1-8f8b-cb139a803072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (fbbadf16-651a-47d5-b308-a37e56aa07f2) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 85, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 37, 'calculated_free_capacity': 82.0, 'virtual_free_capacity': 82.0, 'free_percent': 68.91, 'provisioned_ratio': 0.31, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/82.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 85, total_capacity_gb: 119, allocated_capacity_gb: 37, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 37, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:38.834141] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 82.0, min: 82.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 84, total_capacity_gb: 119, allocated_capacity_gb: 38, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 38, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:39.049374 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (612cad3a-1344-4cd1-8f8b-cb139a803072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (8ce772d8-36d6-4e48-925e-0de956264647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (573c42c3-2ad9-4f56-ae3d-e6c33f7606bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1b6f4dd7-7c5b-4152-851b-59cd5b4deae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1b6f4dd7-7c5b-4152-851b-59cd5b4deae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(13cc73df-7780-4934-8cbd-7f372b1cf57a),volume_id=13cc73df-7780-4934-8cbd-7f372b1cf57a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8cd75620-5692-4b32-857b-fbd8213d24b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (13cc73df-7780-4934-8cbd-7f372b1cf57a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 84, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 38, 'calculated_free_capacity': 81.0, 'virtual_free_capacity': 81.0, 'free_percent': 68.07, 'provisioned_ratio': 0.32, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/81.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 84, total_capacity_gb: 119, allocated_capacity_gb: 38, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 38, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:39.049374] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 81.0, min: 81.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 83, total_capacity_gb: 119, allocated_capacity_gb: 39, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 39, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:39.235337 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8cd75620-5692-4b32-857b-fbd8213d24b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (573c42c3-2ad9-4f56-ae3d-e6c33f7606bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (21f30b1e-063b-4e6f-bab0-1a906c88da3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bbee3d22-8fff-4044-9459-52f268f5484b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bbee3d22-8fff-4044-9459-52f268f5484b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5),volume_id=ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8412d23d-6808-4c79-955f-d7c9b0c92177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 83, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 39, 'calculated_free_capacity': 80.0, 'virtual_free_capacity': 80.0, 'free_percent': 67.23, 'provisioned_ratio': 0.33, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/80.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 83, total_capacity_gb: 119, allocated_capacity_gb: 39, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 39, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:39.235337] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 80.0, min: 80.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 82, total_capacity_gb: 119, allocated_capacity_gb: 40, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 40, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:39.480014 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8412d23d-6808-4c79-955f-d7c9b0c92177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (21f30b1e-063b-4e6f-bab0-1a906c88da3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (17f52f9b-52f5-4cf0-856c-fe0d57db2217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (07da73f9-7c5f-4cee-863a-7d0eaacfbb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (07da73f9-7c5f-4cee-863a-7d0eaacfbb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(68f814b0-1291-4a12-ae65-dc0892203d36),volume_id=68f814b0-1291-4a12-ae65-dc0892203d36,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b262d637-5830-4e11-82e6-9ed47fb704d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (68f814b0-1291-4a12-ae65-dc0892203d36) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 82, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 40, 'calculated_free_capacity': 79.0, 'virtual_free_capacity': 79.0, 'free_percent': 66.39, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/79.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 82, total_capacity_gb: 119, allocated_capacity_gb: 40, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 40, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:39.480014] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weigher CapacityWeigher returned, weigher value is {max: 79.0, min: 79.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:42.572119 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b262d637-5830-4e11-82e6-9ed47fb704d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:44:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (17f52f9b-52f5-4cf0-856c-fe0d57db2217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (e5144a8c-a782-4ea4-9ae7-d3e61b8773c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8c2c7316-2216-47fa-ab10-a49589e2f991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8c2c7316-2216-47fa-ab10-a49589e2f991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(57070f23-6b40-47b9-b9b4-e0d77240f544),volume_id=57070f23-6b40-47b9-b9b4-e0d77240f544,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (64a18d4e-7f5a-445c-9a8e-05e1a043f792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Error scheduling 57070f23-6b40-47b9-b9b4-e0d77240f544 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:45:01 user cinder-scheduler[84081]: INFO cinder.message.api [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Creating message record for request_id = req-e55035f7-bed9-4dad-9cbc-b8b208b454bf Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:45:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 57070f23-6b40-47b9-b9b4-e0d77240f544: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 57070f23-6b40-47b9-b9b4-e0d77240f544 Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Setting Volume 57070f23-6b40-47b9-b9b4-e0d77240f544 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 57070f23-6b40-47b9-b9b4-e0d77240f544 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=82,cinder:UPDATE=17,cinder:INSERT=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Flow 'volume_create_scheduler' (9a7afb8f-8661-408b-b0e1-537b89842d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2de5d1ae-7270-4536-b3de-e335c2d8aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2de5d1ae-7270-4536-b3de-e335c2d8aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a50e9659-3e2d-4f04-b0ac-ae78b8f61fad),volume_id=a50e9659-3e2d-4f04-b0ac-ae78b8f61fad,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f5f89c63-8762-4716-b3fe-898eb51956b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Error scheduling a50e9659-3e2d-4f04-b0ac-ae78b8f61fad from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:45:01 user cinder-scheduler[84081]: INFO cinder.message.api [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Creating message record for request_id = req-e0039512-b662-485b-95d9-48de5642a75d Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (64a18d4e-7f5a-445c-9a8e-05e1a043f792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e55035f7-bed9-4dad-9cbc-b8b208b454bf tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (e5144a8c-a782-4ea4-9ae7-d3e61b8773c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:45:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource a50e9659-3e2d-4f04-b0ac-ae78b8f61fad: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource a50e9659-3e2d-4f04-b0ac-ae78b8f61fad Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Setting Volume a50e9659-3e2d-4f04-b0ac-ae78b8f61fad to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource a50e9659-3e2d-4f04-b0ac-ae78b8f61fad {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f5f89c63-8762-4716-b3fe-898eb51956b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e0039512-b662-485b-95d9-48de5642a75d tempest-CreateVolumesFromSourceVolumeTest-574348635 None] Flow 'volume_create_scheduler' (9a7afb8f-8661-408b-b0e1-537b89842d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Flow 'volume_create_scheduler' (59daa768-d030-4a36-9c1b-7ac6fc4c8395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6da5d2d4-9baf-49e0-81a5-fac358cdb2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6da5d2d4-9baf-49e0-81a5-fac358cdb2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7ce815ce-9603-4fd6-8cc8-9fd798b2f99d),volume_id=7ce815ce-9603-4fd6-8cc8-9fd798b2f99d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (efb85e44-9941-4afa-8f4f-7053f431ce35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:13 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Error scheduling 7ce815ce-9603-4fd6-8cc8-9fd798b2f99d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:45:13 user cinder-scheduler[84081]: INFO cinder.message.api [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Creating message record for request_id = req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b Apr 17 15:45:13 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:45:13 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 7ce815ce-9603-4fd6-8cc8-9fd798b2f99d: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 7ce815ce-9603-4fd6-8cc8-9fd798b2f99d Apr 17 15:45:13 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Setting Volume 7ce815ce-9603-4fd6-8cc8-9fd798b2f99d to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 7ce815ce-9603-4fd6-8cc8-9fd798b2f99d {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:45:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (efb85e44-9941-4afa-8f4f-7053f431ce35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f6a8cdbc-2e40-4ce2-aa75-ceab7e008d2b tempest-VolumesSnapshotTestJSON-1118243512 None] Flow 'volume_create_scheduler' (59daa768-d030-4a36-9c1b-7ac6fc4c8395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=7,cinder:SELECT=20,cinder:INSERT=2,cinder:DELETE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:45:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (64273dca-5a2d-4ad5-a8e7-bf050d8659ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (02a4a915-9a91-4c39-97a9-3d5b633ca2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (02a4a915-9a91-4c39-97a9-3d5b633ca2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(a27d0ff3-5de9-4feb-82f7-d4571af88bb9),volume_id=a27d0ff3-5de9-4feb-82f7-d4571af88bb9,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0606b73a-6391-4cdb-a178-ec4968f0db99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:44 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Error scheduling a27d0ff3-5de9-4feb-82f7-d4571af88bb9 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:45:44 user cinder-scheduler[84081]: INFO cinder.message.api [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Creating message record for request_id = req-52df28ef-59c1-47f6-831b-cf97d2a31df8 Apr 17 15:45:44 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:45:44 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource a27d0ff3-5de9-4feb-82f7-d4571af88bb9: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource a27d0ff3-5de9-4feb-82f7-d4571af88bb9 Apr 17 15:45:44 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Setting Volume a27d0ff3-5de9-4feb-82f7-d4571af88bb9 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource a27d0ff3-5de9-4feb-82f7-d4571af88bb9 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:45:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0606b73a-6391-4cdb-a178-ec4968f0db99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-52df28ef-59c1-47f6-831b-cf97d2a31df8 tempest-ServersNegativeTestJSON-1985071109 None] Flow 'volume_create_scheduler' (64273dca-5a2d-4ad5-a8e7-bf050d8659ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (14e00cfd-8361-4588-b9a3-4e110285cf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fb484d21-d1bc-4781-8459-09a524466ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fb484d21-d1bc-4781-8459-09a524466ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(93a32a7c-4c6a-472a-8f91-9d34558ba232),volume_id=93a32a7c-4c6a-472a-8f91-9d34558ba232,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac1370e3-f5e4-45c0-8b85-870335dd4ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (93a32a7c-4c6a-472a-8f91-9d34558ba232) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 81, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 41, 'calculated_free_capacity': 78.0, 'virtual_free_capacity': 78.0, 'free_percent': 65.55, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/78.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:44:42.572119] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Weigher CapacityWeigher returned, weigher value is {max: 78.0, min: 78.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:45:47.527067 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac1370e3-f5e4-45c0-8b85-870335dd4ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (14e00cfd-8361-4588-b9a3-4e110285cf03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (6854e85a-0e57-4a2d-9a21-9fbaf304e8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e94f14ad-3f07-49d7-94f0-5c306222b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e94f14ad-3f07-49d7-94f0-5c306222b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(441910f8-d29c-4c9e-bc5b-780ad228c85d),volume_id=441910f8-d29c-4c9e-bc5b-780ad228c85d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3ebb80a8-76d3-4881-98a1-74f232a60465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:45:56 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Error scheduling 441910f8-d29c-4c9e-bc5b-780ad228c85d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:45:47.527067 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (441910f8-d29c-4c9e-bc5b-780ad228c85d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 81, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 41, 'calculated_free_capacity': 78.0, 'virtual_free_capacity': 78.0, 'free_percent': 65.55, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/78.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:45:47.527067] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Weigher CapacityWeigher returned, weigher value is {max: 78.0, min: 78.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:45:56.928882 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3ebb80a8-76d3-4881-98a1-74f232a60465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:45:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (6854e85a-0e57-4a2d-9a21-9fbaf304e8fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (e210bc64-4ed1-4633-9771-6a5d3b1bcd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (730fd32f-432b-4c4e-8012-252a03a33642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (730fd32f-432b-4c4e-8012-252a03a33642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5c16bb82-43c5-4d91-9320-0e1f2bbec574),volume_id=5c16bb82-43c5-4d91-9320-0e1f2bbec574,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d8633b13-7903-4b6c-84e4-ed25adbbf400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:03 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Error scheduling 5c16bb82-43c5-4d91-9320-0e1f2bbec574 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:45:56.928882 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (5c16bb82-43c5-4d91-9320-0e1f2bbec574) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 81, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 41, 'calculated_free_capacity': 78.0, 'virtual_free_capacity': 78.0, 'free_percent': 65.55, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/78.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:45:56.928882] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Weigher CapacityWeigher returned, weigher value is {max: 78.0, min: 78.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:03.087438 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d8633b13-7903-4b6c-84e4-ed25adbbf400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (e210bc64-4ed1-4633-9771-6a5d3b1bcd61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=45,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (e149f0bb-9943-4a7c-a746-ec4d974e9d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dd4278a1-fe07-4507-9eac-4d4c9c8a44c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dd4278a1-fe07-4507-9eac-4d4c9c8a44c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2c9714de-f8ea-4d1d-99f9-beb85126ad91),volume_id=2c9714de-f8ea-4d1d-99f9-beb85126ad91,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (24b56b58-931e-4b09-9cc9-509fba2f6115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:18 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Error scheduling 2c9714de-f8ea-4d1d-99f9-beb85126ad91 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:03.087438 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2c9714de-f8ea-4d1d-99f9-beb85126ad91) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 81, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 41, 'calculated_free_capacity': 78.0, 'virtual_free_capacity': 78.0, 'free_percent': 65.55, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/78.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:03.087438] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weigher CapacityWeigher returned, weigher value is {max: 78.0, min: 78.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:18.416227 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (24b56b58-931e-4b09-9cc9-509fba2f6115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (e149f0bb-9943-4a7c-a746-ec4d974e9d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (04aa5c61-6bb4-4edc-8800-30c75ceb0b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (99460bf1-599d-4c89-8cf9-9842c016dbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (99460bf1-599d-4c89-8cf9-9842c016dbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fbbadf16-651a-47d5-b308-a37e56aa07f2),volume_id=fbbadf16-651a-47d5-b308-a37e56aa07f2,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2ba67db3-3f2e-44fc-ae33-017dafae7d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:57 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling fbbadf16-651a-47d5-b308-a37e56aa07f2 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:18.416227 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (fbbadf16-651a-47d5-b308-a37e56aa07f2) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 81, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 41, 'calculated_free_capacity': 78.0, 'virtual_free_capacity': 78.0, 'free_percent': 65.55, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/78.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:18.416227] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 78.0, min: 78.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.462060 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (d686e31a-f8fe-47b8-9d18-9485ca5c6ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (79bc223c-fe3e-4393-be56-0e3ce8f27dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (79bc223c-fe3e-4393-be56-0e3ce8f27dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(dfd745ed-b0c4-4e35-b77c-a911c90ce33e),volume_id=dfd745ed-b0c4-4e35-b77c-a911c90ce33e,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9d99b9bb-2136-49ff-bcaf-7e6ec0706803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:57 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling dfd745ed-b0c4-4e35-b77c-a911c90ce33e from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.462060 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (a129ebbc-ae0c-4aa7-bc20-40c2a98e0e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8f7220cf-6b59-4e5b-bada-6b797c651f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8f7220cf-6b59-4e5b-bada-6b797c651f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(aea45c70-7c05-4146-847e-cbb777d3dfbe),volume_id=aea45c70-7c05-4146-847e-cbb777d3dfbe,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2f6070c3-ce45-4658-923d-b877344cb206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:46:57 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling aea45c70-7c05-4146-847e-cbb777d3dfbe from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 82, total_capacity_gb: 119, allocated_capacity_gb: 40, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 40, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.462060 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2ba67db3-3f2e-44fc-ae33-017dafae7d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (04aa5c61-6bb4-4edc-8800-30c75ceb0b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (dfd745ed-b0c4-4e35-b77c-a911c90ce33e) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 82, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 40, 'calculated_free_capacity': 79.0, 'virtual_free_capacity': 79.0, 'free_percent': 66.39, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/79.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 82, total_capacity_gb: 119, allocated_capacity_gb: 40, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 40, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.462060] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 79.0, min: 79.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.554540 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (aea45c70-7c05-4146-847e-cbb777d3dfbe) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 81, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 41, 'calculated_free_capacity': 78.0, 'virtual_free_capacity': 78.0, 'free_percent': 65.55, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/78.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.554540] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 78.0, min: 78.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.570368 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9d99b9bb-2136-49ff-bcaf-7e6ec0706803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (d686e31a-f8fe-47b8-9d18-9485ca5c6ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2f6070c3-ce45-4658-923d-b877344cb206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:46:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (a129ebbc-ae0c-4aa7-bc20-40c2a98e0e3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (3ac30007-a921-44a8-976a-722617917f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (282075ec-db8c-43c1-b5e0-46b8cbf8de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (282075ec-db8c-43c1-b5e0-46b8cbf8de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5),volume_id=ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a45f9b79-a0cf-45e8-9833-3c478ee5df76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:47:00 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.570368 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (51dbb659-6c43-48cc-bfb7-244f7806479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (070dc88a-0da4-422b-be19-93f70dbe75f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (070dc88a-0da4-422b-be19-93f70dbe75f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(13cc73df-7780-4934-8cbd-7f372b1cf57a),volume_id=13cc73df-7780-4934-8cbd-7f372b1cf57a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4870054f-9eff-47b3-b2d3-69b6dc347096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:47:00 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling 13cc73df-7780-4934-8cbd-7f372b1cf57a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 82, total_capacity_gb: 119, allocated_capacity_gb: 40, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 40, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.570368 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 82, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 40, 'calculated_free_capacity': 79.0, 'virtual_free_capacity': 79.0, 'free_percent': 66.39, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/79.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 82, total_capacity_gb: 119, allocated_capacity_gb: 40, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 40, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:46:57.570368] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 79.0, min: 79.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:00.496572 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (13cc73df-7780-4934-8cbd-7f372b1cf57a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 81, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 41, 'calculated_free_capacity': 78.0, 'virtual_free_capacity': 78.0, 'free_percent': 65.55, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/78.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:00.496572] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 78.0, min: 78.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:00.502616 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a45f9b79-a0cf-45e8-9833-3c478ee5df76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (3ac30007-a921-44a8-976a-722617917f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4870054f-9eff-47b3-b2d3-69b6dc347096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:47:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (51dbb659-6c43-48cc-bfb7-244f7806479c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (20d577c2-e8c7-43ca-a95d-220d53b3dcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2e114c90-d5cb-46b9-9696-e6b7c4c32930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2e114c90-d5cb-46b9-9696-e6b7c4c32930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(68f814b0-1291-4a12-ae65-dc0892203d36),volume_id=68f814b0-1291-4a12-ae65-dc0892203d36,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b001f54a-cde2-4341-8309-d1bd0b777509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:47:03 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Error scheduling 68f814b0-1291-4a12-ae65-dc0892203d36 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:00.502616 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (68f814b0-1291-4a12-ae65-dc0892203d36) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 81, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 41, 'calculated_free_capacity': 78.0, 'virtual_free_capacity': 78.0, 'free_percent': 65.55, 'provisioned_ratio': 0.34, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/78.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 81, total_capacity_gb: 119, allocated_capacity_gb: 41, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 41, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:00.502616] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weigher CapacityWeigher returned, weigher value is {max: 78.0, min: 78.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:03.510387 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b001f54a-cde2-4341-8309-d1bd0b777509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:47:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (20d577c2-e8c7-43ca-a95d-220d53b3dcc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:47:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=58,cinder:UPDATE=15 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:47:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (73d53b04-b7ae-49b9-acf4-1e3d262b3f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (111ef0b3-2cde-4190-b78e-a6b5a0db7651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (111ef0b3-2cde-4190-b78e-a6b5a0db7651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(cdedb820-e1c7-4b86-8286-43b3640b3a46),volume_id=cdedb820-e1c7-4b86-8286-43b3640b3a46,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a139d31f-cf1e-45a8-a742-44f2734f7753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (cdedb820-e1c7-4b86-8286-43b3640b3a46) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 80, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 42, 'calculated_free_capacity': 77.0, 'virtual_free_capacity': 77.0, 'free_percent': 64.71, 'provisioned_ratio': 0.35, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/77.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:03.510387] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weigher CapacityWeigher returned, weigher value is {max: 77.0, min: 77.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:59.301873 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a139d31f-cf1e-45a8-a742-44f2734f7753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:47:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (73d53b04-b7ae-49b9-acf4-1e3d262b3f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (4d2732eb-a124-47e1-a275-eada2edcb289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b6a00488-b8a8-4b74-9910-55ffc661482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b6a00488-b8a8-4b74-9910-55ffc661482a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(93a32a7c-4c6a-472a-8f91-9d34558ba232),volume_id=93a32a7c-4c6a-472a-8f91-9d34558ba232,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4cdb0293-8020-4252-ac20-13c3a65ab29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:48:06 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Error scheduling 93a32a7c-4c6a-472a-8f91-9d34558ba232 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:59.301873 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (93a32a7c-4c6a-472a-8f91-9d34558ba232) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 80, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 42, 'calculated_free_capacity': 77.0, 'virtual_free_capacity': 77.0, 'free_percent': 64.71, 'provisioned_ratio': 0.35, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/77.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:47:59.301873] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Weigher CapacityWeigher returned, weigher value is {max: 77.0, min: 77.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:48:06.511250 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4cdb0293-8020-4252-ac20-13c3a65ab29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:48:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (4d2732eb-a124-47e1-a275-eada2edcb289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:48:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (4312660b-92ae-4d40-8e1d-477a2c79d5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:48:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (10db4019-1e14-4644-ae03-0079ce624ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:48:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (10db4019-1e14-4644-ae03-0079ce624ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(441910f8-d29c-4c9e-bc5b-780ad228c85d),volume_id=441910f8-d29c-4c9e-bc5b-780ad228c85d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:48:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f15f6b9e-3e3e-4773-8b1a-7948630ca1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:48:15 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Error scheduling 441910f8-d29c-4c9e-bc5b-780ad228c85d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:48:15 user cinder-scheduler[84081]: INFO cinder.message.api [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Creating message record for request_id = req-51924a9e-5094-404b-8828-f76cf8bc761a Apr 17 15:48:15 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:48:15 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 441910f8-d29c-4c9e-bc5b-780ad228c85d: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 441910f8-d29c-4c9e-bc5b-780ad228c85d Apr 17 15:48:15 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Setting Volume 441910f8-d29c-4c9e-bc5b-780ad228c85d to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 441910f8-d29c-4c9e-bc5b-780ad228c85d {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:48:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f15f6b9e-3e3e-4773-8b1a-7948630ca1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:48:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-51924a9e-5094-404b-8828-f76cf8bc761a tempest-VolumesActionsTest-707453245 None] Flow 'volume_create_scheduler' (4312660b-92ae-4d40-8e1d-477a2c79d5bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (6c868bb1-cd79-457f-ba9f-54dd9d720c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6498f1c0-27c6-4e47-b26e-c8d4f3786adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6498f1c0-27c6-4e47-b26e-c8d4f3786adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5c16bb82-43c5-4d91-9320-0e1f2bbec574),volume_id=5c16bb82-43c5-4d91-9320-0e1f2bbec574,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (46924742-0d92-4c43-8575-c0ad007ebb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:48:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Error scheduling 5c16bb82-43c5-4d91-9320-0e1f2bbec574 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:48:06.511250 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (5c16bb82-43c5-4d91-9320-0e1f2bbec574) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 80, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 42, 'calculated_free_capacity': 77.0, 'virtual_free_capacity': 77.0, 'free_percent': 64.71, 'provisioned_ratio': 0.35, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/77.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:48:06.511250] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Weigher CapacityWeigher returned, weigher value is {max: 77.0, min: 77.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:48:21.891039 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (46924742-0d92-4c43-8575-c0ad007ebb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:48:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (6c868bb1-cd79-457f-ba9f-54dd9d720c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:48:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=42,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (f365366a-fdcc-4733-a0c6-a2425e0fb389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d1810caf-4fb1-4f91-b178-7da7931c1ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d1810caf-4fb1-4f91-b178-7da7931c1ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2c9714de-f8ea-4d1d-99f9-beb85126ad91),volume_id=2c9714de-f8ea-4d1d-99f9-beb85126ad91,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5d020dc0-f946-4df7-82ff-c36185a306eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:48:37 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Error scheduling 2c9714de-f8ea-4d1d-99f9-beb85126ad91 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:48:21.891039 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2c9714de-f8ea-4d1d-99f9-beb85126ad91) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 80, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 42, 'calculated_free_capacity': 77.0, 'virtual_free_capacity': 77.0, 'free_percent': 64.71, 'provisioned_ratio': 0.35, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/77.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:48:21.891039] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weigher CapacityWeigher returned, weigher value is {max: 77.0, min: 77.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:48:37.253513 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5d020dc0-f946-4df7-82ff-c36185a306eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:48:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (f365366a-fdcc-4733-a0c6-a2425e0fb389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:48:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (1c2cee7f-ebfa-4e7a-9441-382259e8f66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b35de221-295f-4bb3-acc2-0db784d19852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b35de221-295f-4bb3-acc2-0db784d19852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4a2d1c00-a134-4f73-8508-86f35b58acf7),volume_id=4a2d1c00-a134-4f73-8508-86f35b58acf7,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aa2df983-2a14-4c38-be50-696b8f164141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4a2d1c00-a134-4f73-8508-86f35b58acf7) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 79, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 43, 'calculated_free_capacity': 76.0, 'virtual_free_capacity': 76.0, 'free_percent': 63.87, 'provisioned_ratio': 0.36, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/76.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:48:37.253513] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Weigher CapacityWeigher returned, weigher value is {max: 76.0, min: 76.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:15.473957 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aa2df983-2a14-4c38-be50-696b8f164141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (1c2cee7f-ebfa-4e7a-9441-382259e8f66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (15ce55b3-a9d4-41ca-a47f-b51b14cbf5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e8c8f11-c58e-4f47-8472-7b9d71cd51eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6e8c8f11-c58e-4f47-8472-7b9d71cd51eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(aea45c70-7c05-4146-847e-cbb777d3dfbe),volume_id=aea45c70-7c05-4146-847e-cbb777d3dfbe,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (abbab1e9-7cad-4e60-9bd4-009c5558bc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:16 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling aea45c70-7c05-4146-847e-cbb777d3dfbe from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:15.473957 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (aea45c70-7c05-4146-847e-cbb777d3dfbe) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 79, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 43, 'calculated_free_capacity': 76.0, 'virtual_free_capacity': 76.0, 'free_percent': 63.87, 'provisioned_ratio': 0.36, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/76.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:15.473957] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 76.0, min: 76.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.712657 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (2f1f7261-ef08-44a6-96bd-3bbc3e87624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (987d93db-4836-4491-8ae5-31a6eb97659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (987d93db-4836-4491-8ae5-31a6eb97659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fbbadf16-651a-47d5-b308-a37e56aa07f2),volume_id=fbbadf16-651a-47d5-b308-a37e56aa07f2,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c5031b65-687d-4220-a6d2-067bb398d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:16 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling fbbadf16-651a-47d5-b308-a37e56aa07f2 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.712657 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (194e1bfc-e8cb-4e2f-a4c1-2166193596b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4b6e1eea-31d2-45cb-8f32-7a17384d8476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4b6e1eea-31d2-45cb-8f32-7a17384d8476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(dfd745ed-b0c4-4e35-b77c-a911c90ce33e),volume_id=dfd745ed-b0c4-4e35-b77c-a911c90ce33e,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (135e5397-e8ac-40ea-ba4b-1d2a54eabda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:16 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling dfd745ed-b0c4-4e35-b77c-a911c90ce33e from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.712657 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (abbab1e9-7cad-4e60-9bd4-009c5558bc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (15ce55b3-a9d4-41ca-a47f-b51b14cbf5b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (fbbadf16-651a-47d5-b308-a37e56aa07f2) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 80, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 42, 'calculated_free_capacity': 77.0, 'virtual_free_capacity': 77.0, 'free_percent': 64.71, 'provisioned_ratio': 0.35, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/77.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.712657] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 77.0, min: 77.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.807226 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (dfd745ed-b0c4-4e35-b77c-a911c90ce33e) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 79, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 43, 'calculated_free_capacity': 76.0, 'virtual_free_capacity': 76.0, 'free_percent': 63.87, 'provisioned_ratio': 0.36, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/76.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.807226] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 76.0, min: 76.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.820008 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c5031b65-687d-4220-a6d2-067bb398d84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (2f1f7261-ef08-44a6-96bd-3bbc3e87624e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (135e5397-e8ac-40ea-ba4b-1d2a54eabda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (194e1bfc-e8cb-4e2f-a4c1-2166193596b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (2f59a21c-bece-47b0-8768-0bb66a26da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (27e485da-4ba0-4ea0-801d-4d83a79ded00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (27e485da-4ba0-4ea0-801d-4d83a79ded00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(13cc73df-7780-4934-8cbd-7f372b1cf57a),volume_id=13cc73df-7780-4934-8cbd-7f372b1cf57a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7b1a3cfe-990c-484a-b227-71a35fff665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:19 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling 13cc73df-7780-4934-8cbd-7f372b1cf57a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.820008 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (8419c108-66e7-4738-bbe6-a22d6fbd44cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2cf19514-3af3-4eab-b896-5e046b5c04ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2cf19514-3af3-4eab-b896-5e046b5c04ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5),volume_id=ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (91cf0d4f-727a-46ca-bea5-bda9dd645430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:19 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.820008 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (13cc73df-7780-4934-8cbd-7f372b1cf57a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 80, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 42, 'calculated_free_capacity': 77.0, 'virtual_free_capacity': 77.0, 'free_percent': 64.71, 'provisioned_ratio': 0.35, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/77.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 80, total_capacity_gb: 119, allocated_capacity_gb: 42, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 42, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:16.820008] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 77.0, min: 77.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:19.768341 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 79, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 43, 'calculated_free_capacity': 76.0, 'virtual_free_capacity': 76.0, 'free_percent': 63.87, 'provisioned_ratio': 0.36, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/76.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:19.768341] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Weigher CapacityWeigher returned, weigher value is {max: 76.0, min: 76.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:19.781421 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (91cf0d4f-727a-46ca-bea5-bda9dd645430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (8419c108-66e7-4738-bbe6-a22d6fbd44cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7b1a3cfe-990c-484a-b227-71a35fff665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (2f59a21c-bece-47b0-8768-0bb66a26da6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (3152ef3f-3e4a-46db-a865-33c560455181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (27ba40be-35bc-42df-8422-ba90b80d2106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (27ba40be-35bc-42df-8422-ba90b80d2106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(68f814b0-1291-4a12-ae65-dc0892203d36),volume_id=68f814b0-1291-4a12-ae65-dc0892203d36,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bbf6dcfc-f8a4-444a-a7de-13fc4996fdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:49:22 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Error scheduling 68f814b0-1291-4a12-ae65-dc0892203d36 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:19.781421 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (68f814b0-1291-4a12-ae65-dc0892203d36) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 79, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 43, 'calculated_free_capacity': 76.0, 'virtual_free_capacity': 76.0, 'free_percent': 63.87, 'provisioned_ratio': 0.36, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/76.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 79, total_capacity_gb: 119, allocated_capacity_gb: 43, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 43, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:19.781421] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weigher CapacityWeigher returned, weigher value is {max: 76.0, min: 76.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:22.741993 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bbf6dcfc-f8a4-444a-a7de-13fc4996fdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:49:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (3152ef3f-3e4a-46db-a865-33c560455181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:49:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=18,cinder:SELECT=69 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (79607512-3e47-4666-8dc4-35aad6d363f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (68a006ef-2937-40ef-a766-dbf9264774ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (68a006ef-2937-40ef-a766-dbf9264774ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2ed5b8aa-fb48-4255-b6d5-f0f84f733834),volume_id=2ed5b8aa-fb48-4255-b6d5-f0f84f733834,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6a4e7f03-7b19-4dfe-83b6-3595548c492c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2ed5b8aa-fb48-4255-b6d5-f0f84f733834) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 78, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 44, 'calculated_free_capacity': 75.0, 'virtual_free_capacity': 75.0, 'free_percent': 63.03, 'provisioned_ratio': 0.37, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/75.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:49:22.741993] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Weigher CapacityWeigher returned, weigher value is {max: 75.0, min: 75.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 77, total_capacity_gb: 119, allocated_capacity_gb: 45, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 45, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:50:04.734597 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6a4e7f03-7b19-4dfe-83b6-3595548c492c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (79607512-3e47-4666-8dc4-35aad6d363f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (f2040f3d-83c8-46b3-a534-113748c04ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3dee1997-d6d8-453f-8c02-eebc6af25d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3dee1997-d6d8-453f-8c02-eebc6af25d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(cdedb820-e1c7-4b86-8286-43b3640b3a46),volume_id=cdedb820-e1c7-4b86-8286-43b3640b3a46,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c839c174-ecc5-4af7-a3ab-150bfab6e2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:15 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Error scheduling cdedb820-e1c7-4b86-8286-43b3640b3a46 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:50:04.734597 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (cdedb820-e1c7-4b86-8286-43b3640b3a46) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 78, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 44, 'calculated_free_capacity': 75.0, 'virtual_free_capacity': 75.0, 'free_percent': 63.03, 'provisioned_ratio': 0.37, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/75.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:50:04.734597] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weigher CapacityWeigher returned, weigher value is {max: 75.0, min: 75.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 77, total_capacity_gb: 119, allocated_capacity_gb: 45, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 45, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:50:15.645304 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c839c174-ecc5-4af7-a3ab-150bfab6e2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (f2040f3d-83c8-46b3-a534-113748c04ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (82282f0d-ea54-4b65-96c5-a9767c786069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ff263e8b-99b6-455f-89d1-1959da02d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ff263e8b-99b6-455f-89d1-1959da02d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(93a32a7c-4c6a-472a-8f91-9d34558ba232),volume_id=93a32a7c-4c6a-472a-8f91-9d34558ba232,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f4d43a35-0435-45f0-b50a-ebde7aef2a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:24 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Error scheduling 93a32a7c-4c6a-472a-8f91-9d34558ba232 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:50:15.645304 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (93a32a7c-4c6a-472a-8f91-9d34558ba232) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 78, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 44, 'calculated_free_capacity': 75.0, 'virtual_free_capacity': 75.0, 'free_percent': 63.03, 'provisioned_ratio': 0.37, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/75.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:50:15.645304] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Weigher CapacityWeigher returned, weigher value is {max: 75.0, min: 75.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 77, total_capacity_gb: 119, allocated_capacity_gb: 45, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 45, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:50:24.902130 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f4d43a35-0435-45f0-b50a-ebde7aef2a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (82282f0d-ea54-4b65-96c5-a9767c786069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:50:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=35,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:50:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (f7f4feb0-73cb-4c58-81aa-fe3ccb8cf770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:50:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a9b7ef96-776b-4811-a074-346283412cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a9b7ef96-776b-4811-a074-346283412cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(5c16bb82-43c5-4d91-9320-0e1f2bbec574),volume_id=5c16bb82-43c5-4d91-9320-0e1f2bbec574,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8c4d8fe3-6d71-4a4d-af1b-fd3b6c0974a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:37 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Error scheduling 5c16bb82-43c5-4d91-9320-0e1f2bbec574 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:50:37 user cinder-scheduler[84081]: INFO cinder.message.api [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Creating message record for request_id = req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b Apr 17 15:50:37 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:50:37 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 5c16bb82-43c5-4d91-9320-0e1f2bbec574: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 5c16bb82-43c5-4d91-9320-0e1f2bbec574 Apr 17 15:50:37 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Setting Volume 5c16bb82-43c5-4d91-9320-0e1f2bbec574 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 5c16bb82-43c5-4d91-9320-0e1f2bbec574 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:50:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8c4d8fe3-6d71-4a4d-af1b-fd3b6c0974a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-17ff3f5b-2f53-46f9-aad4-ca363f7dd09b tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (f7f4feb0-73cb-4c58-81aa-fe3ccb8cf770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:50:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (658bdf58-8d54-4f1e-ad56-294b7ef80275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:50:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (95a0339b-256f-4a32-8849-477bebcd9ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (95a0339b-256f-4a32-8849-477bebcd9ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2c9714de-f8ea-4d1d-99f9-beb85126ad91),volume_id=2c9714de-f8ea-4d1d-99f9-beb85126ad91,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (982bc5f1-5b38-43d0-bec1-8240190409d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:50:55 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Error scheduling 2c9714de-f8ea-4d1d-99f9-beb85126ad91 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:50:55 user cinder-scheduler[84081]: INFO cinder.message.api [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Creating message record for request_id = req-636827e5-ca50-4d75-a738-9b54469bf4fe Apr 17 15:50:55 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:50:55 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2c9714de-f8ea-4d1d-99f9-beb85126ad91: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2c9714de-f8ea-4d1d-99f9-beb85126ad91 Apr 17 15:50:55 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Setting Volume 2c9714de-f8ea-4d1d-99f9-beb85126ad91 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2c9714de-f8ea-4d1d-99f9-beb85126ad91 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:50:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (982bc5f1-5b38-43d0-bec1-8240190409d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:50:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-64a49643-ef0f-426a-909b-8f85130cc57b req-636827e5-ca50-4d75-a738-9b54469bf4fe tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (658bdf58-8d54-4f1e-ad56-294b7ef80275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=21,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (8a6fa338-9d0c-4f7b-a0fe-f163081b0a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9787cf06-47eb-4f7e-98ac-e4864d958d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9787cf06-47eb-4f7e-98ac-e4864d958d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4a2d1c00-a134-4f73-8508-86f35b58acf7),volume_id=4a2d1c00-a134-4f73-8508-86f35b58acf7,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (812ee552-4e9d-4da9-9288-988cdb2689cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:33 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Error scheduling 4a2d1c00-a134-4f73-8508-86f35b58acf7 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:50:24.902130 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4a2d1c00-a134-4f73-8508-86f35b58acf7) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 78, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 44, 'calculated_free_capacity': 75.0, 'virtual_free_capacity': 75.0, 'free_percent': 63.03, 'provisioned_ratio': 0.37, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/75.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 78, total_capacity_gb: 119, allocated_capacity_gb: 44, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 44, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:50:24.902130] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Weigher CapacityWeigher returned, weigher value is {max: 75.0, min: 75.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 77, total_capacity_gb: 119, allocated_capacity_gb: 45, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 45, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:51:33.603299 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (812ee552-4e9d-4da9-9288-988cdb2689cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (8a6fa338-9d0c-4f7b-a0fe-f163081b0a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:51:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (dfc867e6-5942-40fb-88ec-148d253691ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e0799c8a-8c65-497e-bb14-b99858c3500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e0799c8a-8c65-497e-bb14-b99858c3500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(aea45c70-7c05-4146-847e-cbb777d3dfbe),volume_id=aea45c70-7c05-4146-847e-cbb777d3dfbe,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fd7c43b5-c77d-4772-b239-117d8c4f0bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:36 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling aea45c70-7c05-4146-847e-cbb777d3dfbe from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:51:36 user cinder-scheduler[84081]: INFO cinder.message.api [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Creating message record for request_id = req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f Apr 17 15:51:36 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:51:37 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource aea45c70-7c05-4146-847e-cbb777d3dfbe: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource aea45c70-7c05-4146-847e-cbb777d3dfbe Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Setting Volume aea45c70-7c05-4146-847e-cbb777d3dfbe to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource aea45c70-7c05-4146-847e-cbb777d3dfbe {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (dfad0191-47c6-44f7-8407-4067ba23f154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (13d4656c-0a1d-4f0e-8f5a-5836dfa94b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (13d4656c-0a1d-4f0e-8f5a-5836dfa94b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fbbadf16-651a-47d5-b308-a37e56aa07f2),volume_id=fbbadf16-651a-47d5-b308-a37e56aa07f2,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (55513ce3-99f1-4394-910f-41c96898180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:37 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling fbbadf16-651a-47d5-b308-a37e56aa07f2 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:51:37 user cinder-scheduler[84081]: INFO cinder.message.api [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Creating message record for request_id = req-be98cecd-d344-4ab9-b5f6-c268a7041adb Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (5d302ca5-c255-4a58-9fd3-68fac8e8a7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e31a4b4a-38a2-41de-9229-76e120cecf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e31a4b4a-38a2-41de-9229-76e120cecf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(dfd745ed-b0c4-4e35-b77c-a911c90ce33e),volume_id=dfd745ed-b0c4-4e35-b77c-a911c90ce33e,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3a195f69-60ef-4da7-9a10-bf2b8c5543b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:37 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling dfd745ed-b0c4-4e35-b77c-a911c90ce33e from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:51:37 user cinder-scheduler[84081]: INFO cinder.message.api [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Creating message record for request_id = req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fd7c43b5-c77d-4772-b239-117d8c4f0bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-cc50532e-b5e8-48ec-b211-ceaeda0b2b5f tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (dfc867e6-5942-40fb-88ec-148d253691ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:51:37 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource dfd745ed-b0c4-4e35-b77c-a911c90ce33e: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource dfd745ed-b0c4-4e35-b77c-a911c90ce33e Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Setting Volume dfd745ed-b0c4-4e35-b77c-a911c90ce33e to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource dfd745ed-b0c4-4e35-b77c-a911c90ce33e {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:51:37 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource fbbadf16-651a-47d5-b308-a37e56aa07f2: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource fbbadf16-651a-47d5-b308-a37e56aa07f2 Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Setting Volume fbbadf16-651a-47d5-b308-a37e56aa07f2 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource fbbadf16-651a-47d5-b308-a37e56aa07f2 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3a195f69-60ef-4da7-9a10-bf2b8c5543b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9e42bf27-3da0-4fae-8992-c1ade2f352d6 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (5d302ca5-c255-4a58-9fd3-68fac8e8a7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (55513ce3-99f1-4394-910f-41c96898180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-be98cecd-d344-4ab9-b5f6-c268a7041adb tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (dfad0191-47c6-44f7-8407-4067ba23f154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (76a46183-ee38-4014-9504-880606be6b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b5646331-dcf6-4f99-a639-7dd4c896e9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b5646331-dcf6-4f99-a639-7dd4c896e9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5),volume_id=ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7060efd1-b7e8-4cee-add2-110ff7b74ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:39 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:51:39 user cinder-scheduler[84081]: INFO cinder.message.api [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Creating message record for request_id = req-27d7b7b3-4675-424c-af48-cc2422ffc813 Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:51:39 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5 Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Setting Volume ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource ab5889f8-b6c7-4673-a666-f4b4e5ff5fd5 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (ea3b304e-77ac-4633-a5da-5f1952f04bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0218906f-70a2-48e8-9fab-9cae964e4f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0218906f-70a2-48e8-9fab-9cae964e4f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(13cc73df-7780-4934-8cbd-7f372b1cf57a),volume_id=13cc73df-7780-4934-8cbd-7f372b1cf57a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7f6b748c-5aa6-4c8b-b585-3e6c6c18d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:39 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Error scheduling 13cc73df-7780-4934-8cbd-7f372b1cf57a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:51:39 user cinder-scheduler[84081]: INFO cinder.message.api [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Creating message record for request_id = req-9b871d6d-58e3-4523-b328-b6ffa7aca14e Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7060efd1-b7e8-4cee-add2-110ff7b74ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-27d7b7b3-4675-424c-af48-cc2422ffc813 tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (76a46183-ee38-4014-9504-880606be6b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:40 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:51:40 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 13cc73df-7780-4934-8cbd-7f372b1cf57a: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 13cc73df-7780-4934-8cbd-7f372b1cf57a Apr 17 15:51:40 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Setting Volume 13cc73df-7780-4934-8cbd-7f372b1cf57a to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 13cc73df-7780-4934-8cbd-7f372b1cf57a {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:51:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7f6b748c-5aa6-4c8b-b585-3e6c6c18d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9b871d6d-58e3-4523-b328-b6ffa7aca14e tempest-CreateVolumesFromImageTest-286787744 None] Flow 'volume_create_scheduler' (ea3b304e-77ac-4633-a5da-5f1952f04bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (f3c85968-a5b2-48d8-801c-8fe3407a39ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:51:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4fb2265a-e84b-4eff-870c-de7c2bc9bd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4fb2265a-e84b-4eff-870c-de7c2bc9bd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(68f814b0-1291-4a12-ae65-dc0892203d36),volume_id=68f814b0-1291-4a12-ae65-dc0892203d36,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ded18050-9952-42b7-be29-f458d8456453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:51:42 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Error scheduling 68f814b0-1291-4a12-ae65-dc0892203d36 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:51:42 user cinder-scheduler[84081]: INFO cinder.message.api [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Creating message record for request_id = req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 Apr 17 15:51:42 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:51:42 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 68f814b0-1291-4a12-ae65-dc0892203d36: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 68f814b0-1291-4a12-ae65-dc0892203d36 Apr 17 15:51:42 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Setting Volume 68f814b0-1291-4a12-ae65-dc0892203d36 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 68f814b0-1291-4a12-ae65-dc0892203d36 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:51:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ded18050-9952-42b7-be29-f458d8456453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:51:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d6f50cc2-dcfd-47fa-a26e-c827106b2f51 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (f3c85968-a5b2-48d8-801c-8fe3407a39ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:52:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=15,cinder:SELECT=45,cinder:INSERT=6,cinder:DELETE=6 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (cffec9d8-56a2-44a9-906e-a3112b6375af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4794e74b-ab81-44a4-8acf-8e895f75ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4794e74b-ab81-44a4-8acf-8e895f75ce22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(60979eba-96b1-4cb3-bae1-8874a86cb411),volume_id=60979eba-96b1-4cb3-bae1-8874a86cb411,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (908c6c84-ccfe-456d-8aa5-a58b918932c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (60979eba-96b1-4cb3-bae1-8874a86cb411) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 77, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 45, 'calculated_free_capacity': 74.0, 'virtual_free_capacity': 74.0, 'free_percent': 62.18, 'provisioned_ratio': 0.38, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/74.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 77, total_capacity_gb: 119, allocated_capacity_gb: 45, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 45, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:51:33.603299] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Weigher CapacityWeigher returned, weigher value is {max: 74.0, min: 74.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:52:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 76, total_capacity_gb: 119, allocated_capacity_gb: 46, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 46, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:52:19.978939 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:52:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (908c6c84-ccfe-456d-8aa5-a58b918932c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:52:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (cffec9d8-56a2-44a9-906e-a3112b6375af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (eb385600-19d5-47be-8826-73238c10e247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4b4a8ba5-b283-4013-850c-3426ca536b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4b4a8ba5-b283-4013-850c-3426ca536b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2ed5b8aa-fb48-4255-b6d5-f0f84f733834),volume_id=2ed5b8aa-fb48-4255-b6d5-f0f84f733834,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7c1af063-54cf-4b59-98e4-fd56c04f47fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:52:22 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Error scheduling 2ed5b8aa-fb48-4255-b6d5-f0f84f733834 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 77, total_capacity_gb: 119, allocated_capacity_gb: 45, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 45, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:52:19.978939 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2ed5b8aa-fb48-4255-b6d5-f0f84f733834) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 77, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 45, 'calculated_free_capacity': 74.0, 'virtual_free_capacity': 74.0, 'free_percent': 62.18, 'provisioned_ratio': 0.38, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/74.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 77, total_capacity_gb: 119, allocated_capacity_gb: 45, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 45, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:52:19.978939] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Weigher CapacityWeigher returned, weigher value is {max: 74.0, min: 74.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 76, total_capacity_gb: 119, allocated_capacity_gb: 46, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 46, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:52:22.776510 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7c1af063-54cf-4b59-98e4-fd56c04f47fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:52:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (eb385600-19d5-47be-8826-73238c10e247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=8,cinder:SELECT=29 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (e0c8276f-ac4a-40bb-8de5-c3cfe43298fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (847b8acc-1add-48fc-8fdb-7314a759a2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (847b8acc-1add-48fc-8fdb-7314a759a2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(cdedb820-e1c7-4b86-8286-43b3640b3a46),volume_id=cdedb820-e1c7-4b86-8286-43b3640b3a46,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (61421555-0284-4986-a880-8c532248a364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:52:35 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Error scheduling cdedb820-e1c7-4b86-8286-43b3640b3a46 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 77, total_capacity_gb: 119, allocated_capacity_gb: 45, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 45, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:52:22.776510 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (cdedb820-e1c7-4b86-8286-43b3640b3a46) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 77, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 45, 'calculated_free_capacity': 74.0, 'virtual_free_capacity': 74.0, 'free_percent': 62.18, 'provisioned_ratio': 0.38, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/74.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 77, total_capacity_gb: 119, allocated_capacity_gb: 45, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 45, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:52:22.776510] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weigher CapacityWeigher returned, weigher value is {max: 74.0, min: 74.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 76, total_capacity_gb: 119, allocated_capacity_gb: 46, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 46, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:52:35.090903 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (61421555-0284-4986-a880-8c532248a364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:52:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (e0c8276f-ac4a-40bb-8de5-c3cfe43298fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:52:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (a9623ab3-44f8-4b34-b4fb-495af0ef7d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:52:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83a7da87-29f8-4013-acc5-457cce60db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:52:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83a7da87-29f8-4013-acc5-457cce60db9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(93a32a7c-4c6a-472a-8f91-9d34558ba232),volume_id=93a32a7c-4c6a-472a-8f91-9d34558ba232,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:52:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (38fdf688-4765-46e7-9c45-051f2680de2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:52:44 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Error scheduling 93a32a7c-4c6a-472a-8f91-9d34558ba232 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:52:44 user cinder-scheduler[84081]: INFO cinder.message.api [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Creating message record for request_id = req-2e8657c3-b442-4332-be65-3527a8839b0a Apr 17 15:52:44 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:52:44 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 93a32a7c-4c6a-472a-8f91-9d34558ba232: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 93a32a7c-4c6a-472a-8f91-9d34558ba232 Apr 17 15:52:44 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Setting Volume 93a32a7c-4c6a-472a-8f91-9d34558ba232 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 93a32a7c-4c6a-472a-8f91-9d34558ba232 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:52:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (38fdf688-4765-46e7-9c45-051f2680de2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:52:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2e8657c3-b442-4332-be65-3527a8839b0a tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (a9623ab3-44f8-4b34-b4fb-495af0ef7d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (b1c4a9d1-875d-4cc2-9775-6f5471d7f459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fe979a01-5fc1-4269-b240-2e8ee5c69470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fe979a01-5fc1-4269-b240-2e8ee5c69470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(45e5cc09-6c97-438a-a6a2-c89e7d725ce5),volume_id=45e5cc09-6c97-438a-a6a2-c89e7d725ce5,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a1ae5d01-7baf-4bb7-a403-6f788dd8ea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (45e5cc09-6c97-438a-a6a2-c89e7d725ce5) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 76, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 46, 'calculated_free_capacity': 73.0, 'virtual_free_capacity': 73.0, 'free_percent': 61.34, 'provisioned_ratio': 0.39, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/73.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 76, total_capacity_gb: 119, allocated_capacity_gb: 46, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 46, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:52:35.090903] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Weigher CapacityWeigher returned, weigher value is {max: 73.0, min: 73.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 75, total_capacity_gb: 119, allocated_capacity_gb: 47, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 47, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:53:02.660202 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a1ae5d01-7baf-4bb7-a403-6f788dd8ea87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:53:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (b1c4a9d1-875d-4cc2-9775-6f5471d7f459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:53:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=34,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (00023084-8a4d-414d-b82d-b96268fbf754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5effbb14-7f48-4b02-8a6b-729bc25d1cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5effbb14-7f48-4b02-8a6b-729bc25d1cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4a2d1c00-a134-4f73-8508-86f35b58acf7),volume_id=4a2d1c00-a134-4f73-8508-86f35b58acf7,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7713ceab-2191-4419-8276-9bfcc663744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:53:53 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Error scheduling 4a2d1c00-a134-4f73-8508-86f35b58acf7 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 76, total_capacity_gb: 119, allocated_capacity_gb: 46, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 46, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:53:02.660202 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4a2d1c00-a134-4f73-8508-86f35b58acf7) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 76, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 46, 'calculated_free_capacity': 73.0, 'virtual_free_capacity': 73.0, 'free_percent': 61.34, 'provisioned_ratio': 0.39, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/73.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 76, total_capacity_gb: 119, allocated_capacity_gb: 46, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 46, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:53:02.660202] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Weigher CapacityWeigher returned, weigher value is {max: 73.0, min: 73.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 75, total_capacity_gb: 119, allocated_capacity_gb: 47, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 47, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:53:53.812717 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7713ceab-2191-4419-8276-9bfcc663744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:53:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (00023084-8a4d-414d-b82d-b96268fbf754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (4395d16d-2e73-41e5-88fd-8eabfc9943aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6662751e-27d3-4a4a-95ed-0e7f84bd0b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6662751e-27d3-4a4a-95ed-0e7f84bd0b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b29a7592-128a-41ee-a8e2-57780dee33e7),volume_id=b29a7592-128a-41ee-a8e2-57780dee33e7,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (13073379-9b8f-4233-b250-b232b753d313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b29a7592-128a-41ee-a8e2-57780dee33e7) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 75, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 47, 'calculated_free_capacity': 72.0, 'virtual_free_capacity': 72.0, 'free_percent': 60.5, 'provisioned_ratio': 0.39, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/72.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 75, total_capacity_gb: 119, allocated_capacity_gb: 47, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 47, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:53:53.812717] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Weigher CapacityWeigher returned, weigher value is {max: 72.0, min: 72.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 74, total_capacity_gb: 119, allocated_capacity_gb: 48, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 48, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:30.399464 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (13073379-9b8f-4233-b250-b232b753d313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:30 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (4395d16d-2e73-41e5-88fd-8eabfc9943aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (5ff21253-7d31-46c5-8b6b-fc67b7320d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a5fa28e3-68fb-4675-9217-95b747cce85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a5fa28e3-68fb-4675-9217-95b747cce85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(75163b78-31b2-4676-b93b-542a8ea784c1),volume_id=75163b78-31b2-4676-b93b-542a8ea784c1,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b6290b6c-8653-445a-971c-83bbfad898c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (75163b78-31b2-4676-b93b-542a8ea784c1) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 74, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 48, 'calculated_free_capacity': 71.0, 'virtual_free_capacity': 71.0, 'free_percent': 59.66, 'provisioned_ratio': 0.4, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/71.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 74, total_capacity_gb: 119, allocated_capacity_gb: 48, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 48, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:30.399464] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weigher CapacityWeigher returned, weigher value is {max: 71.0, min: 71.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 73, total_capacity_gb: 119, allocated_capacity_gb: 49, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 49, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:35.270103 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b6290b6c-8653-445a-971c-83bbfad898c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (5ff21253-7d31-46c5-8b6b-fc67b7320d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (049fb95c-5f67-4d01-a9fb-8ea9b64e3e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d05c77d4-220a-40d8-9b3a-72e2672f0891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d05c77d4-220a-40d8-9b3a-72e2672f0891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(60979eba-96b1-4cb3-bae1-8874a86cb411),volume_id=60979eba-96b1-4cb3-bae1-8874a86cb411,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1fd2b768-dd81-4ad9-9791-8a9640687161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:36 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Error scheduling 60979eba-96b1-4cb3-bae1-8874a86cb411 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 74, total_capacity_gb: 119, allocated_capacity_gb: 48, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 48, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:35.270103 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (60979eba-96b1-4cb3-bae1-8874a86cb411) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 74, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 48, 'calculated_free_capacity': 71.0, 'virtual_free_capacity': 71.0, 'free_percent': 59.66, 'provisioned_ratio': 0.4, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/71.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 74, total_capacity_gb: 119, allocated_capacity_gb: 48, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 48, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:35.270103] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Weigher CapacityWeigher returned, weigher value is {max: 71.0, min: 71.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:54:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 73, total_capacity_gb: 119, allocated_capacity_gb: 49, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 49, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:36.940964 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:54:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1fd2b768-dd81-4ad9-9791-8a9640687161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (049fb95c-5f67-4d01-a9fb-8ea9b64e3e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (a5e72c3d-5252-420f-91fc-1ee56b5e9080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (efd54a1c-4665-4f6e-b8db-f0be82cde097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (efd54a1c-4665-4f6e-b8db-f0be82cde097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2ed5b8aa-fb48-4255-b6d5-f0f84f733834),volume_id=2ed5b8aa-fb48-4255-b6d5-f0f84f733834,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b08c592f-d7bf-442f-bf9f-068e5ed26e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:43 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Error scheduling 2ed5b8aa-fb48-4255-b6d5-f0f84f733834 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 74, total_capacity_gb: 119, allocated_capacity_gb: 48, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 48, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:36.940964 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2ed5b8aa-fb48-4255-b6d5-f0f84f733834) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 74, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 48, 'calculated_free_capacity': 71.0, 'virtual_free_capacity': 71.0, 'free_percent': 59.66, 'provisioned_ratio': 0.4, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/71.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 74, total_capacity_gb: 119, allocated_capacity_gb: 48, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 48, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:36.940964] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Weigher CapacityWeigher returned, weigher value is {max: 71.0, min: 71.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 73, total_capacity_gb: 119, allocated_capacity_gb: 49, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 49, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:43.109901 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b08c592f-d7bf-442f-bf9f-068e5ed26e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (a5e72c3d-5252-420f-91fc-1ee56b5e9080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=47,cinder:UPDATE=11 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:54:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (09426ee0-8368-4dd3-afd1-e5a85a93b829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:54:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ba702f46-574e-4fe5-90c7-a78cbf26f5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ba702f46-574e-4fe5-90c7-a78cbf26f5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(cdedb820-e1c7-4b86-8286-43b3640b3a46),volume_id=cdedb820-e1c7-4b86-8286-43b3640b3a46,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d7845600-f731-4e66-a85e-07dc92e34da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:54:55 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Error scheduling cdedb820-e1c7-4b86-8286-43b3640b3a46 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:54:55 user cinder-scheduler[84081]: INFO cinder.message.api [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Creating message record for request_id = req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 Apr 17 15:54:55 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:54:55 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource cdedb820-e1c7-4b86-8286-43b3640b3a46: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource cdedb820-e1c7-4b86-8286-43b3640b3a46 Apr 17 15:54:55 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Setting Volume cdedb820-e1c7-4b86-8286-43b3640b3a46 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource cdedb820-e1c7-4b86-8286-43b3640b3a46 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:54:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d7845600-f731-4e66-a85e-07dc92e34da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:54:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f132425-c80e-4ea2-bea2-42fd2887f8a2 tempest-ServerRescueNegativeTestJSON-1346397943 None] Flow 'volume_create_scheduler' (09426ee0-8368-4dd3-afd1-e5a85a93b829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (786de1de-58c1-439e-9139-5797bd2ad063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (22c69c30-ce97-4fe2-b8fd-3dc961ff29ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (22c69c30-ce97-4fe2-b8fd-3dc961ff29ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(87514055-5a0f-459f-b10b-438d7a13d39d),volume_id=87514055-5a0f-459f-b10b-438d7a13d39d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f9f83158-b098-42a6-b99a-c1061aa46a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (87514055-5a0f-459f-b10b-438d7a13d39d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 73, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 49, 'calculated_free_capacity': 70.0, 'virtual_free_capacity': 70.0, 'free_percent': 58.82, 'provisioned_ratio': 0.41, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/70.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 73, total_capacity_gb: 119, allocated_capacity_gb: 49, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 49, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:54:43.109901] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Weigher CapacityWeigher returned, weigher value is {max: 70.0, min: 70.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 72, total_capacity_gb: 119, allocated_capacity_gb: 50, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 50, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:55:17.498804 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f9f83158-b098-42a6-b99a-c1061aa46a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:55:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (786de1de-58c1-439e-9139-5797bd2ad063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (7bba0013-ef03-4bc0-9da4-829b18e356e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f3e1bdb8-307a-4e93-aeea-9907d38cf047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f3e1bdb8-307a-4e93-aeea-9907d38cf047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0),volume_id=14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (56d4bb30-ca45-4ae6-885d-8006b1c42aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 72, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 50, 'calculated_free_capacity': 69.0, 'virtual_free_capacity': 69.0, 'free_percent': 57.98, 'provisioned_ratio': 0.42, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/69.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 72, total_capacity_gb: 119, allocated_capacity_gb: 50, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 50, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:55:17.498804] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Weigher CapacityWeigher returned, weigher value is {max: 69.0, min: 69.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:55:22.481725 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (56d4bb30-ca45-4ae6-885d-8006b1c42aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:55:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (7bba0013-ef03-4bc0-9da4-829b18e356e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (cf69ae41-d7bd-4ba9-989d-689e2fb46df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a70bb6ac-2edd-4a21-8307-3abfca37f2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a70bb6ac-2edd-4a21-8307-3abfca37f2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(45e5cc09-6c97-438a-a6a2-c89e7d725ce5),volume_id=45e5cc09-6c97-438a-a6a2-c89e7d725ce5,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (83dac9a1-d9fe-43d2-80c4-eb09d9aa589e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:55:23 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Error scheduling 45e5cc09-6c97-438a-a6a2-c89e7d725ce5 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 72, total_capacity_gb: 119, allocated_capacity_gb: 50, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 50, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:55:22.481725 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (45e5cc09-6c97-438a-a6a2-c89e7d725ce5) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 72, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 50, 'calculated_free_capacity': 69.0, 'virtual_free_capacity': 69.0, 'free_percent': 57.98, 'provisioned_ratio': 0.42, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/69.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 72, total_capacity_gb: 119, allocated_capacity_gb: 50, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 50, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:55:22.481725] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Weigher CapacityWeigher returned, weigher value is {max: 69.0, min: 69.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:55:23.704723 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (83dac9a1-d9fe-43d2-80c4-eb09d9aa589e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:55:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (cf69ae41-d7bd-4ba9-989d-689e2fb46df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:55:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=45,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:56:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:56:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (09451055-89bf-4973-aeab-c800e23c606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:56:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a03d441f-5592-4e25-97c7-a540c4108b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a03d441f-5592-4e25-97c7-a540c4108b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4a2d1c00-a134-4f73-8508-86f35b58acf7),volume_id=4a2d1c00-a134-4f73-8508-86f35b58acf7,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (45a44bec-fd82-4a26-937e-170936f5b647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:13 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Error scheduling 4a2d1c00-a134-4f73-8508-86f35b58acf7 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:56:13 user cinder-scheduler[84081]: INFO cinder.message.api [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Creating message record for request_id = req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a Apr 17 15:56:13 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:56:13 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 4a2d1c00-a134-4f73-8508-86f35b58acf7: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 4a2d1c00-a134-4f73-8508-86f35b58acf7 Apr 17 15:56:13 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Setting Volume 4a2d1c00-a134-4f73-8508-86f35b58acf7 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 4a2d1c00-a134-4f73-8508-86f35b58acf7 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:56:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (45a44bec-fd82-4a26-937e-170936f5b647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c68061bd-1bdf-4eaf-8a2b-14e439bed46a tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (09451055-89bf-4973-aeab-c800e23c606f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:56:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-802ddca2-07e5-44be-8b13-67d2ef9820b7 tempest-VolumePoolsAdminTestsJSON-480442021 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:56:22 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9a55bcf5-f042-4d55-994b-577617165956 tempest-VolumePoolsAdminTestsJSON-480442021 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Flow 'volume_create_scheduler' (3cdbad56-4805-4a8b-be23-0fde19d913c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a0eb5f5f-40fb-49b6-b810-0f0688b9d039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a0eb5f5f-40fb-49b6-b810-0f0688b9d039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff),volume_id=bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff,volume_properties=VolumeProperties,volume_type=VolumeType(c9c52f37-7390-466f-a6ab-56ae9a61e5ed))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (36de5e41-a483-4182-b91d-efb5342ecf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 71, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 51, 'calculated_free_capacity': 68.0, 'virtual_free_capacity': 68.0, 'free_percent': 57.14, 'provisioned_ratio': 0.43, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/68.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:55:23.704723] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Weigher CapacityWeigher returned, weigher value is {max: 68.0, min: 68.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 70, total_capacity_gb: 119, allocated_capacity_gb: 52, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 52, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:25.832767 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (36de5e41-a483-4182-b91d-efb5342ecf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Flow 'volume_create_scheduler' (3cdbad56-4805-4a8b-be23-0fde19d913c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:56:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=33,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (176281f5-699b-4ee2-883c-6a323f213d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2244fc52-1987-4974-957d-7bf0e81f3480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2244fc52-1987-4974-957d-7bf0e81f3480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b29a7592-128a-41ee-a8e2-57780dee33e7),volume_id=b29a7592-128a-41ee-a8e2-57780dee33e7,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (00165390-3231-46ce-91bf-7322845c6900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:47 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Error scheduling b29a7592-128a-41ee-a8e2-57780dee33e7 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:25.832767 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b29a7592-128a-41ee-a8e2-57780dee33e7) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 71, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 51, 'calculated_free_capacity': 68.0, 'virtual_free_capacity': 68.0, 'free_percent': 57.14, 'provisioned_ratio': 0.43, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/68.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:25.832767] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Weigher CapacityWeigher returned, weigher value is {max: 68.0, min: 68.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 70, total_capacity_gb: 119, allocated_capacity_gb: 52, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 52, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:47.858777 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (00165390-3231-46ce-91bf-7322845c6900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (176281f5-699b-4ee2-883c-6a323f213d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (3178adbe-0645-4b4c-84dd-44196b54c42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (060b98e9-3324-4aa0-b4dc-316d2e1af163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (060b98e9-3324-4aa0-b4dc-316d2e1af163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(75163b78-31b2-4676-b93b-542a8ea784c1),volume_id=75163b78-31b2-4676-b93b-542a8ea784c1,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (12ff5001-cd47-4757-915b-bafb52e03a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:54 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Error scheduling 75163b78-31b2-4676-b93b-542a8ea784c1 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:47.858777 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (4248e0de-b2f9-480b-b14f-d296046726ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7aef02a8-d605-423d-ad77-898be8f82f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7aef02a8-d605-423d-ad77-898be8f82f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(60979eba-96b1-4cb3-bae1-8874a86cb411),volume_id=60979eba-96b1-4cb3-bae1-8874a86cb411,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f0313ca3-2b96-4ebf-a65c-ed16bed4a49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:56:54 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Error scheduling 60979eba-96b1-4cb3-bae1-8874a86cb411 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 72, total_capacity_gb: 119, allocated_capacity_gb: 50, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 50, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:47.858777 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (75163b78-31b2-4676-b93b-542a8ea784c1) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 72, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 50, 'calculated_free_capacity': 69.0, 'virtual_free_capacity': 69.0, 'free_percent': 57.98, 'provisioned_ratio': 0.42, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/69.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 72, total_capacity_gb: 119, allocated_capacity_gb: 50, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 50, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:47.858777] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weigher CapacityWeigher returned, weigher value is {max: 69.0, min: 69.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:54.070642 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (60979eba-96b1-4cb3-bae1-8874a86cb411) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 71, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 51, 'calculated_free_capacity': 68.0, 'virtual_free_capacity': 68.0, 'free_percent': 57.14, 'provisioned_ratio': 0.43, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/68.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:54.070642] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Weigher CapacityWeigher returned, weigher value is {max: 68.0, min: 68.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 70, total_capacity_gb: 119, allocated_capacity_gb: 52, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 52, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:54.083180 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (12ff5001-cd47-4757-915b-bafb52e03a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (3178adbe-0645-4b4c-84dd-44196b54c42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f0313ca3-2b96-4ebf-a65c-ed16bed4a49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:56:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (4248e0de-b2f9-480b-b14f-d296046726ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (6f908d6e-4bfd-4a72-9627-482d53cfe34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (81f9ee65-f263-430d-8c21-6a8e63423aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (81f9ee65-f263-430d-8c21-6a8e63423aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2ed5b8aa-fb48-4255-b6d5-f0f84f733834),volume_id=2ed5b8aa-fb48-4255-b6d5-f0f84f733834,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4114db0d-b37d-463c-a74a-de10ca98bb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:00 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Error scheduling 2ed5b8aa-fb48-4255-b6d5-f0f84f733834 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:57:00 user cinder-scheduler[84081]: INFO cinder.message.api [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Creating message record for request_id = req-4381eeaf-f88c-49c3-a64f-a647fc1596cd Apr 17 15:57:00 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:57:00 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2ed5b8aa-fb48-4255-b6d5-f0f84f733834: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2ed5b8aa-fb48-4255-b6d5-f0f84f733834 Apr 17 15:57:00 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Setting Volume 2ed5b8aa-fb48-4255-b6d5-f0f84f733834 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2ed5b8aa-fb48-4255-b6d5-f0f84f733834 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:57:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4114db0d-b37d-463c-a74a-de10ca98bb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4381eeaf-f88c-49c3-a64f-a647fc1596cd tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (6f908d6e-4bfd-4a72-9627-482d53cfe34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=42,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (7c2ed1f2-86f6-41a6-976e-42f3f4b9aa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (99b3adb4-e2a0-4632-a20e-d522d5f31e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (99b3adb4-e2a0-4632-a20e-d522d5f31e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(87514055-5a0f-459f-b10b-438d7a13d39d),volume_id=87514055-5a0f-459f-b10b-438d7a13d39d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9bbf0a63-7bb9-42a7-b6ab-91f9d9fa3931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:37 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Error scheduling 87514055-5a0f-459f-b10b-438d7a13d39d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:54.083180 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (87514055-5a0f-459f-b10b-438d7a13d39d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 71, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 51, 'calculated_free_capacity': 68.0, 'virtual_free_capacity': 68.0, 'free_percent': 57.14, 'provisioned_ratio': 0.43, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/68.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:56:54.083180] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Weigher CapacityWeigher returned, weigher value is {max: 68.0, min: 68.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 70, total_capacity_gb: 119, allocated_capacity_gb: 52, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 52, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:37.721826 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9bbf0a63-7bb9-42a7-b6ab-91f9d9fa3931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (7c2ed1f2-86f6-41a6-976e-42f3f4b9aa57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (982c5df8-9ca8-4c67-adcf-f0e309adc60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2cd303c1-485c-45b2-b653-9d92848824d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2cd303c1-485c-45b2-b653-9d92848824d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0),volume_id=14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3b8decd6-72e4-4fbf-8f45-bbe75216d068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:40 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Error scheduling 14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:37.721826 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 71, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 51, 'calculated_free_capacity': 68.0, 'virtual_free_capacity': 68.0, 'free_percent': 57.14, 'provisioned_ratio': 0.43, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/68.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:37.721826] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Weigher CapacityWeigher returned, weigher value is {max: 68.0, min: 68.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 70, total_capacity_gb: 119, allocated_capacity_gb: 52, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 52, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:40.779077 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (3b8decd6-72e4-4fbf-8f45-bbe75216d068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (982c5df8-9ca8-4c67-adcf-f0e309adc60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (98e0815c-2e94-42ad-87b7-a95b7584e58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ef10edda-e672-4b2f-af27-65c606f3a63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ef10edda-e672-4b2f-af27-65c606f3a63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(45e5cc09-6c97-438a-a6a2-c89e7d725ce5),volume_id=45e5cc09-6c97-438a-a6a2-c89e7d725ce5,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1c8b6bab-4c93-4798-b941-7c4e62a7e1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:43 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Error scheduling 45e5cc09-6c97-438a-a6a2-c89e7d725ce5 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:40.779077 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (45e5cc09-6c97-438a-a6a2-c89e7d725ce5) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 71, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 51, 'calculated_free_capacity': 68.0, 'virtual_free_capacity': 68.0, 'free_percent': 57.14, 'provisioned_ratio': 0.43, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/68.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 71, total_capacity_gb: 119, allocated_capacity_gb: 51, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 51, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:40.779077] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Weigher CapacityWeigher returned, weigher value is {max: 68.0, min: 68.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 70, total_capacity_gb: 119, allocated_capacity_gb: 52, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 52, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:43.886465 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1c8b6bab-4c93-4798-b941-7c4e62a7e1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (98e0815c-2e94-42ad-87b7-a95b7584e58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (3bd82641-6d04-43dc-bd0f-e264969179fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ebdf1093-0399-47f2-b424-bc6b6b805793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ebdf1093-0399-47f2-b424-bc6b6b805793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb),volume_id=9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a10ce472-cd6a-45df-9721-8206819a8b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 70, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 52, 'calculated_free_capacity': 67.0, 'virtual_free_capacity': 67.0, 'free_percent': 56.3, 'provisioned_ratio': 0.44, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/67.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 70, total_capacity_gb: 119, allocated_capacity_gb: 52, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 52, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:43.886465] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Weigher CapacityWeigher returned, weigher value is {max: 67.0, min: 67.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 69, total_capacity_gb: 119, allocated_capacity_gb: 53, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 53, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:47.168378 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a10ce472-cd6a-45df-9721-8206819a8b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:57:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (3bd82641-6d04-43dc-bd0f-e264969179fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:57:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=44,cinder:UPDATE=11 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:58:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Flow 'volume_create_scheduler' (758b2d97-6fa7-48d4-b362-d9fc07b2c4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2796b0dc-d46f-4809-b49f-09ba3d72cb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2796b0dc-d46f-4809-b49f-09ba3d72cb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff),volume_id=bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff,volume_properties=VolumeProperties,volume_type=VolumeType(c9c52f37-7390-466f-a6ab-56ae9a61e5ed))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0de41862-1f5a-463e-b930-8d8b3ccfec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:58:46 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Error scheduling bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 70, total_capacity_gb: 119, allocated_capacity_gb: 52, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 52, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:47.168378 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 70, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 52, 'calculated_free_capacity': 67.0, 'virtual_free_capacity': 67.0, 'free_percent': 56.3, 'provisioned_ratio': 0.44, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/67.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 70, total_capacity_gb: 119, allocated_capacity_gb: 52, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 52, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:57:47.168378] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Weigher CapacityWeigher returned, weigher value is {max: 67.0, min: 67.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 69, total_capacity_gb: 119, allocated_capacity_gb: 53, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 53, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:58:46.943968 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0de41862-1f5a-463e-b930-8d8b3ccfec14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:58:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Flow 'volume_create_scheduler' (758b2d97-6fa7-48d4-b362-d9fc07b2c4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (75e0c433-d018-48eb-a64d-3e8581d492f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (41f0a119-04e7-40f9-80cc-1581ce17911b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (41f0a119-04e7-40f9-80cc-1581ce17911b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fd313648-5fc1-4e6a-97a0-92ac803b36fd),volume_id=fd313648-5fc1-4e6a-97a0-92ac803b36fd,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0abe28cd-734a-45c5-ae7b-253bcbf4648a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (fd313648-5fc1-4e6a-97a0-92ac803b36fd) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 69, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 53, 'calculated_free_capacity': 66.0, 'virtual_free_capacity': 66.0, 'free_percent': 55.46, 'provisioned_ratio': 0.45, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/66.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 69, total_capacity_gb: 119, allocated_capacity_gb: 53, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 53, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:58:46.943968] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Weigher CapacityWeigher returned, weigher value is {max: 66.0, min: 66.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:58:53.778534 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0abe28cd-734a-45c5-ae7b-253bcbf4648a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:58:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (75e0c433-d018-48eb-a64d-3e8581d492f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:58:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=27,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (9b8761b5-f531-4932-9bf7-465a788b27b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0bab77da-794b-4071-94bd-93dfbfb561a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0bab77da-794b-4071-94bd-93dfbfb561a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b29a7592-128a-41ee-a8e2-57780dee33e7),volume_id=b29a7592-128a-41ee-a8e2-57780dee33e7,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5da0f17e-dadd-4865-b456-cd77435f7c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:08 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Error scheduling b29a7592-128a-41ee-a8e2-57780dee33e7 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 69, total_capacity_gb: 119, allocated_capacity_gb: 53, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 53, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:58:53.778534 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b29a7592-128a-41ee-a8e2-57780dee33e7) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 69, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 53, 'calculated_free_capacity': 66.0, 'virtual_free_capacity': 66.0, 'free_percent': 55.46, 'provisioned_ratio': 0.45, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/66.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 69, total_capacity_gb: 119, allocated_capacity_gb: 53, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 53, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:58:53.778534] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Weigher CapacityWeigher returned, weigher value is {max: 66.0, min: 66.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:08.663547 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5da0f17e-dadd-4865-b456-cd77435f7c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (9b8761b5-f531-4932-9bf7-465a788b27b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (67e05168-6e8d-4c55-b0bf-0c18d203a62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (621cee84-c2a4-4eb9-928e-08f4bb6aaad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (621cee84-c2a4-4eb9-928e-08f4bb6aaad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(75163b78-31b2-4676-b93b-542a8ea784c1),volume_id=75163b78-31b2-4676-b93b-542a8ea784c1,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0225bb30-a408-4f36-a917-12494f23c01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:14 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Error scheduling 75163b78-31b2-4676-b93b-542a8ea784c1 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 69, total_capacity_gb: 119, allocated_capacity_gb: 53, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 53, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:08.663547 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (0d3bf5c7-36c8-4b2c-ba90-4568ec3be065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4f181199-b73d-45dc-ba44-3d79f168e63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4f181199-b73d-45dc-ba44-3d79f168e63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(60979eba-96b1-4cb3-bae1-8874a86cb411),volume_id=60979eba-96b1-4cb3-bae1-8874a86cb411,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7d9c0542-ef74-4ca8-b44d-abba69dad0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:14 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Error scheduling 60979eba-96b1-4cb3-bae1-8874a86cb411 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:59:14 user cinder-scheduler[84081]: INFO cinder.message.api [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Creating message record for request_id = req-c605e44a-ec00-461d-b74d-10bd8a32bea2 Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (75163b78-31b2-4676-b93b-542a8ea784c1) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 69, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 53, 'calculated_free_capacity': 66.0, 'virtual_free_capacity': 66.0, 'free_percent': 55.46, 'provisioned_ratio': 0.45, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/66.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 69, total_capacity_gb: 119, allocated_capacity_gb: 53, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 53, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:08.663547] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weigher CapacityWeigher returned, weigher value is {max: 66.0, min: 66.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:14.680562 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:59:14 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 60979eba-96b1-4cb3-bae1-8874a86cb411: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 60979eba-96b1-4cb3-bae1-8874a86cb411 Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Setting Volume 60979eba-96b1-4cb3-bae1-8874a86cb411 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 60979eba-96b1-4cb3-bae1-8874a86cb411 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7d9c0542-ef74-4ca8-b44d-abba69dad0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c605e44a-ec00-461d-b74d-10bd8a32bea2 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (0d3bf5c7-36c8-4b2c-ba90-4568ec3be065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0225bb30-a408-4f36-a917-12494f23c01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (67e05168-6e8d-4c55-b0bf-0c18d203a62c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=31,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Flow 'volume_create_scheduler' (1e1dc3da-4819-4cb9-b258-ce9a343c4f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5dbdf529-5d1f-40ee-b04a-7fff0ffa8d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5dbdf529-5d1f-40ee-b04a-7fff0ffa8d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(26014b4e-ec84-4011-a69f-ed42c3424a24),volume_id=26014b4e-ec84-4011-a69f-ed42c3424a24,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f2b824e1-8e07-4b03-90ee-5a5e47b29b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (26014b4e-ec84-4011-a69f-ed42c3424a24) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 68, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 54, 'calculated_free_capacity': 65.0, 'virtual_free_capacity': 65.0, 'free_percent': 54.62, 'provisioned_ratio': 0.45, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/65.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:14.680562] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Weigher CapacityWeigher returned, weigher value is {max: 65.0, min: 65.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 67, total_capacity_gb: 119, allocated_capacity_gb: 55, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 55, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:45.678471 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f2b824e1-8e07-4b03-90ee-5a5e47b29b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Flow 'volume_create_scheduler' (1e1dc3da-4819-4cb9-b258-ce9a343c4f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=22,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (b9b1565d-250e-4be0-866f-b17434b9209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5a7aa06b-7958-451e-92fd-b83611d7fac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5a7aa06b-7958-451e-92fd-b83611d7fac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(87514055-5a0f-459f-b10b-438d7a13d39d),volume_id=87514055-5a0f-459f-b10b-438d7a13d39d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ffaa5fc7-f384-4ce7-9138-18ccb2b09775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:55 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Error scheduling 87514055-5a0f-459f-b10b-438d7a13d39d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:45.678471 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (87514055-5a0f-459f-b10b-438d7a13d39d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 68, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 54, 'calculated_free_capacity': 65.0, 'virtual_free_capacity': 65.0, 'free_percent': 54.62, 'provisioned_ratio': 0.45, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/65.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:45.678471] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Weigher CapacityWeigher returned, weigher value is {max: 65.0, min: 65.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 67, total_capacity_gb: 119, allocated_capacity_gb: 55, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 55, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:55.151036 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ffaa5fc7-f384-4ce7-9138-18ccb2b09775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (b9b1565d-250e-4be0-866f-b17434b9209e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (8d74c1e8-0a7b-4f45-a4a1-aaf3a09fbe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7cde72e8-b78a-48bd-a248-3a87ff6bc963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7cde72e8-b78a-48bd-a248-3a87ff6bc963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0),volume_id=14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c31947ec-a579-4bd1-b60e-b6ef6b3385d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 15:59:58 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Error scheduling 14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:55.151036 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 68, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 54, 'calculated_free_capacity': 65.0, 'virtual_free_capacity': 65.0, 'free_percent': 54.62, 'provisioned_ratio': 0.45, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/65.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:55.151036] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Weigher CapacityWeigher returned, weigher value is {max: 65.0, min: 65.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 67, total_capacity_gb: 119, allocated_capacity_gb: 55, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 55, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:58.244368 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c31947ec-a579-4bd1-b60e-b6ef6b3385d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 15:59:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (8d74c1e8-0a7b-4f45-a4a1-aaf3a09fbe7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:00:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (2c731172-2f0f-4166-a74f-fa62e45a542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:00:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5b898ee3-0e4e-4352-b044-dae59cb43be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:00:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5b898ee3-0e4e-4352-b044-dae59cb43be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(45e5cc09-6c97-438a-a6a2-c89e7d725ce5),volume_id=45e5cc09-6c97-438a-a6a2-c89e7d725ce5,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:00:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7be39e02-b091-4128-98c1-332c06edb7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:00:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Error scheduling 45e5cc09-6c97-438a-a6a2-c89e7d725ce5 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:00:01 user cinder-scheduler[84081]: INFO cinder.message.api [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Creating message record for request_id = req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 Apr 17 16:00:01 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:00:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 45e5cc09-6c97-438a-a6a2-c89e7d725ce5: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 45e5cc09-6c97-438a-a6a2-c89e7d725ce5 Apr 17 16:00:01 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Setting Volume 45e5cc09-6c97-438a-a6a2-c89e7d725ce5 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 45e5cc09-6c97-438a-a6a2-c89e7d725ce5 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:00:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7be39e02-b091-4128-98c1-332c06edb7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:00:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-99373bb6-c6e6-4fce-8296-10f7a0995ca3 tempest-TestMinimumBasicScenario-1774469422 None] Flow 'volume_create_scheduler' (2c731172-2f0f-4166-a74f-fa62e45a542c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (ccd44d6e-e2bb-4fec-b469-5ae394a7f0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5cb8ef72-2710-44a9-8102-df12682aee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5cb8ef72-2710-44a9-8102-df12682aee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb),volume_id=9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f40aa78d-72a0-4152-a641-de08094fb9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:00:04 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Error scheduling 9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:58.244368 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 68, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 54, 'calculated_free_capacity': 65.0, 'virtual_free_capacity': 65.0, 'free_percent': 54.62, 'provisioned_ratio': 0.45, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/65.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 68, total_capacity_gb: 119, allocated_capacity_gb: 54, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 54, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 15:59:58.244368] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Weigher CapacityWeigher returned, weigher value is {max: 65.0, min: 65.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 67, total_capacity_gb: 119, allocated_capacity_gb: 55, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 55, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:00:04.340326 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f40aa78d-72a0-4152-a641-de08094fb9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:00:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (ccd44d6e-e2bb-4fec-b469-5ae394a7f0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:00:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=11,cinder:SELECT=37,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Flow 'volume_create_scheduler' (28aa4497-36f3-4819-8a09-65fbf983ac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8fccc663-eaaf-41f1-9c9d-3c08bf67665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8fccc663-eaaf-41f1-9c9d-3c08bf67665e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=c0c829d5-daba-4365-b51f-aabe77d8aa62,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(40efe2ca-3a61-44c9-b9e0-bb29b333f0f9),volume_id=40efe2ca-3a61-44c9-b9e0-bb29b333f0f9,volume_properties=VolumeProperties,volume_type=VolumeType(27e07afb-6233-4285-b990-341afc23321e))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fe735867-aff1-422f-8d48-bfec6ea4fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (40efe2ca-3a61-44c9-b9e0-bb29b333f0f9) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 67, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 55, 'calculated_free_capacity': 64.0, 'virtual_free_capacity': 64.0, 'free_percent': 53.78, 'provisioned_ratio': 0.46, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/64.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 67, total_capacity_gb: 119, allocated_capacity_gb: 55, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 55, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:00:04.340326] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Weigher CapacityWeigher returned, weigher value is {max: 64.0, min: 64.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 66, total_capacity_gb: 119, allocated_capacity_gb: 56, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 56, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:00:37.800163 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fe735867-aff1-422f-8d48-bfec6ea4fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:00:37 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Flow 'volume_create_scheduler' (28aa4497-36f3-4819-8a09-65fbf983ac73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (e17a6dca-970c-41bb-a364-319b49563172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4fe3e3dd-4c55-43c0-a9bb-49b2f820c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4fe3e3dd-4c55-43c0-a9bb-49b2f820c150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc),volume_id=b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eb15fd9b-9cd5-4670-b5f9-b445337791ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 66, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 56, 'calculated_free_capacity': 63.0, 'virtual_free_capacity': 63.0, 'free_percent': 52.94, 'provisioned_ratio': 0.47, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/63.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 66, total_capacity_gb: 119, allocated_capacity_gb: 56, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 56, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:00:37.800163] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Weigher CapacityWeigher returned, weigher value is {max: 63.0, min: 63.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:00:44.369186 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eb15fd9b-9cd5-4670-b5f9-b445337791ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:00:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (e17a6dca-970c-41bb-a364-319b49563172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Flow 'volume_create_scheduler' (888e05e0-9996-4653-a491-e85956ca1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3e545d64-ee16-4b92-8ca6-ae58416a959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3e545d64-ee16-4b92-8ca6-ae58416a959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff),volume_id=bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff,volume_properties=VolumeProperties,volume_type=VolumeType(c9c52f37-7390-466f-a6ab-56ae9a61e5ed))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fdcabca9-9986-49c6-b55e-f8f2b393abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:06 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Error scheduling bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 66, total_capacity_gb: 119, allocated_capacity_gb: 56, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 56, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:00:44.369186 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 66, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 56, 'calculated_free_capacity': 63.0, 'virtual_free_capacity': 63.0, 'free_percent': 52.94, 'provisioned_ratio': 0.47, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/63.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 66, total_capacity_gb: 119, allocated_capacity_gb: 56, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 56, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:00:44.369186] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Weigher CapacityWeigher returned, weigher value is {max: 63.0, min: 63.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:01:06.452281 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fdcabca9-9986-49c6-b55e-f8f2b393abe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Flow 'volume_create_scheduler' (888e05e0-9996-4653-a491-e85956ca1584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (b1ec1354-f84c-45b4-b60a-f785d416d1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dfd69eea-7818-4ee5-bbb3-76d94395aaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dfd69eea-7818-4ee5-bbb3-76d94395aaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fd313648-5fc1-4e6a-97a0-92ac803b36fd),volume_id=fd313648-5fc1-4e6a-97a0-92ac803b36fd,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d5ffe64f-0a92-48f1-ab0a-6ff6ec35e8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:12 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Error scheduling fd313648-5fc1-4e6a-97a0-92ac803b36fd from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 66, total_capacity_gb: 119, allocated_capacity_gb: 56, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 56, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:01:06.452281 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (fd313648-5fc1-4e6a-97a0-92ac803b36fd) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 66, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 56, 'calculated_free_capacity': 63.0, 'virtual_free_capacity': 63.0, 'free_percent': 52.94, 'provisioned_ratio': 0.47, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/63.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 66, total_capacity_gb: 119, allocated_capacity_gb: 56, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 56, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:01:06.452281] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Weigher CapacityWeigher returned, weigher value is {max: 63.0, min: 63.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:01:12.560358 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d5ffe64f-0a92-48f1-ab0a-6ff6ec35e8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (b1ec1354-f84c-45b4-b60a-f785d416d1a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (6f1d6215-5f03-4262-be09-10450b034b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3820f752-f005-4ebb-9825-fd3b903cd3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3820f752-f005-4ebb-9825-fd3b903cd3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(63b2c7c3-8482-49d4-bb89-c4ccf3f2db82),volume_id=63b2c7c3-8482-49d4-bb89-c4ccf3f2db82,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5e0f701a-cec5-4b2b-906e-3372a7d97b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (63b2c7c3-8482-49d4-bb89-c4ccf3f2db82) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 65, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 57, 'calculated_free_capacity': 62.0, 'virtual_free_capacity': 62.0, 'free_percent': 52.1, 'provisioned_ratio': 0.48, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/62.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:01:12.560358] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Weigher CapacityWeigher returned, weigher value is {max: 62.0, min: 62.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:01:19.601088 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5e0f701a-cec5-4b2b-906e-3372a7d97b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (6f1d6215-5f03-4262-be09-10450b034b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (9f43f7ca-1c08-457c-9abe-a102e360a2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (382894ca-9447-4a27-b056-e90082882a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (382894ca-9447-4a27-b056-e90082882a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b29a7592-128a-41ee-a8e2-57780dee33e7),volume_id=b29a7592-128a-41ee-a8e2-57780dee33e7,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4de21b4f-d3f0-4a31-a8ef-5fcaf3a9c736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:27 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Error scheduling b29a7592-128a-41ee-a8e2-57780dee33e7 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:01:27 user cinder-scheduler[84081]: INFO cinder.message.api [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Creating message record for request_id = req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b Apr 17 16:01:27 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:01:27 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource b29a7592-128a-41ee-a8e2-57780dee33e7: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource b29a7592-128a-41ee-a8e2-57780dee33e7 Apr 17 16:01:27 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Setting Volume b29a7592-128a-41ee-a8e2-57780dee33e7 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource b29a7592-128a-41ee-a8e2-57780dee33e7 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:01:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4de21b4f-d3f0-4a31-a8ef-5fcaf3a9c736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-eb524e6a-d44c-4107-91cc-ffa4d4a5bf1b tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (9f43f7ca-1c08-457c-9abe-a102e360a2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (4273734b-5f2c-4c13-a198-b933b21d977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a9e40dd-aee3-4b77-8ea2-224c1b44d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a9e40dd-aee3-4b77-8ea2-224c1b44d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(75163b78-31b2-4676-b93b-542a8ea784c1),volume_id=75163b78-31b2-4676-b93b-542a8ea784c1,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ebe16ce8-2c8c-4660-9fdd-7e2c16841eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:01:34 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Error scheduling 75163b78-31b2-4676-b93b-542a8ea784c1 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:01:34 user cinder-scheduler[84081]: INFO cinder.message.api [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Creating message record for request_id = req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 Apr 17 16:01:34 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:01:34 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 75163b78-31b2-4676-b93b-542a8ea784c1: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 75163b78-31b2-4676-b93b-542a8ea784c1 Apr 17 16:01:34 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Setting Volume 75163b78-31b2-4676-b93b-542a8ea784c1 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 75163b78-31b2-4676-b93b-542a8ea784c1 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:01:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ebe16ce8-2c8c-4660-9fdd-7e2c16841eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:01:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-ccaee0c2-d84b-4650-899b-f7362672ce71 req-a5a6e5c2-62b5-4a76-9bf8-dbfd32544a07 tempest-ServerBootFromVolumeStableRescueTest-1271370980 None] Flow 'volume_create_scheduler' (4273734b-5f2c-4c13-a198-b933b21d977d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:01:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=51,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Flow 'volume_create_scheduler' (44a83c45-7ac7-43f8-abca-8606e0e643c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a6517014-0401-456f-a64e-80ea2517a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a6517014-0401-456f-a64e-80ea2517a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(26014b4e-ec84-4011-a69f-ed42c3424a24),volume_id=26014b4e-ec84-4011-a69f-ed42c3424a24,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (01a14ef3-c2d7-44bc-8a77-014d032e3be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:06 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Error scheduling 26014b4e-ec84-4011-a69f-ed42c3424a24 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:01:19.601088 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (26014b4e-ec84-4011-a69f-ed42c3424a24) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 65, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 57, 'calculated_free_capacity': 62.0, 'virtual_free_capacity': 62.0, 'free_percent': 52.1, 'provisioned_ratio': 0.48, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/62.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:01:19.601088] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Weigher CapacityWeigher returned, weigher value is {max: 62.0, min: 62.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:02:06.081878 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (01a14ef3-c2d7-44bc-8a77-014d032e3be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Flow 'volume_create_scheduler' (44a83c45-7ac7-43f8-abca-8606e0e643c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:02:15 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:02:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (4e12e7a0-cf07-4e3d-be73-185cae904c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:02:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0baf1e94-9fae-4170-a8f8-d1ba514c29f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0baf1e94-9fae-4170-a8f8-d1ba514c29f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(87514055-5a0f-459f-b10b-438d7a13d39d),volume_id=87514055-5a0f-459f-b10b-438d7a13d39d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fd3f2b68-c61c-43bc-86f7-d00f8703be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:15 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Error scheduling 87514055-5a0f-459f-b10b-438d7a13d39d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:02:15 user cinder-scheduler[84081]: INFO cinder.message.api [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Creating message record for request_id = req-5a40883b-32f9-400a-a3f7-129f4d4677bb Apr 17 16:02:15 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:02:15 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 87514055-5a0f-459f-b10b-438d7a13d39d: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 87514055-5a0f-459f-b10b-438d7a13d39d Apr 17 16:02:15 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Setting Volume 87514055-5a0f-459f-b10b-438d7a13d39d to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 87514055-5a0f-459f-b10b-438d7a13d39d {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:02:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (fd3f2b68-c61c-43bc-86f7-d00f8703be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a40883b-32f9-400a-a3f7-129f4d4677bb tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (4e12e7a0-cf07-4e3d-be73-185cae904c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:02:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (6c267d0a-7f0b-4779-9598-10643c8a2a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:02:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9b45d357-6ee0-47ff-ba44-a3645cb0491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9b45d357-6ee0-47ff-ba44-a3645cb0491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0),volume_id=14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2196fc8c-9dbd-47b3-af2b-7c8bf8fb5a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:18 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Error scheduling 14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:02:18 user cinder-scheduler[84081]: INFO cinder.message.api [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Creating message record for request_id = req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 Apr 17 16:02:18 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:02:18 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0 Apr 17 16:02:18 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Setting Volume 14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 14aa38ea-7cbb-48f7-a9aa-ffcc7b66faa0 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:02:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2196fc8c-9dbd-47b3-af2b-7c8bf8fb5a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e5f547d7-ac89-4987-be0b-aaa457cd4a79 tempest-ServerActionsTestJSON-645547919 None] Flow 'volume_create_scheduler' (6c267d0a-7f0b-4779-9598-10643c8a2a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (a521395e-2c61-4821-9323-f379dfc1412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1e58f67e-c3ea-4a45-88dd-340c5b36eb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1e58f67e-c3ea-4a45-88dd-340c5b36eb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb),volume_id=9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c4d52e0b-073c-43c4-a22d-f58d1d8e4162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:24 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Error scheduling 9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:02:06.081878 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 65, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 57, 'calculated_free_capacity': 62.0, 'virtual_free_capacity': 62.0, 'free_percent': 52.1, 'provisioned_ratio': 0.48, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/62.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:02:06.081878] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Weigher CapacityWeigher returned, weigher value is {max: 62.0, min: 62.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:02:24.532674 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c4d52e0b-073c-43c4-a22d-f58d1d8e4162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (a521395e-2c61-4821-9323-f379dfc1412b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:02:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=29,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Flow 'volume_create_scheduler' (568c9e6c-f791-4f89-9c45-be8712d78ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (74ac3088-12e6-4e66-b137-c57f5b3abc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (74ac3088-12e6-4e66-b137-c57f5b3abc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=c0c829d5-daba-4365-b51f-aabe77d8aa62,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(40efe2ca-3a61-44c9-b9e0-bb29b333f0f9),volume_id=40efe2ca-3a61-44c9-b9e0-bb29b333f0f9,volume_properties=VolumeProperties,volume_type=VolumeType(27e07afb-6233-4285-b990-341afc23321e))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d9aca481-eb52-482a-8d14-853a5d07ac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:02:58 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Error scheduling 40efe2ca-3a61-44c9-b9e0-bb29b333f0f9 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1115, in _create_from_image\n model_update, cloned = self._prepare_image_cache_entry(\n', ' File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun\n return caller(func, *(extras + args), **kw)\n', ' File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized\n return f(*a, **k)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 894, in _prepare_image_cache_entry\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1004, in _create_from_image_cache_or_download\n model_update = self._create_from_image_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 791, in _create_from_image_download\n model_update = self.driver.create_volume(volume) or {}\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:02:24.532674 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (40efe2ca-3a61-44c9-b9e0-bb29b333f0f9) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 65, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 57, 'calculated_free_capacity': 62.0, 'virtual_free_capacity': 62.0, 'free_percent': 52.1, 'provisioned_ratio': 0.48, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/62.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:02:24.532674] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Weigher CapacityWeigher returned, weigher value is {max: 62.0, min: 62.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:02:58.961377 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d9aca481-eb52-482a-8d14-853a5d07ac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:02:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Flow 'volume_create_scheduler' (568c9e6c-f791-4f89-9c45-be8712d78ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Flow 'volume_create_scheduler' (24bb843d-6289-44b3-af26-5e8340cba45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bae555a1-391e-4711-b031-50fd50f51b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bae555a1-391e-4711-b031-50fd50f51b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=c0c829d5-daba-4365-b51f-aabe77d8aa62,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(40efe2ca-3a61-44c9-b9e0-bb29b333f0f9),volume_id=40efe2ca-3a61-44c9-b9e0-bb29b333f0f9,volume_properties=VolumeProperties,volume_type=VolumeType(27e07afb-6233-4285-b990-341afc23321e))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1e1b7999-dc9b-4569-8d3f-e2ed6a4f344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:00 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Error scheduling 40efe2ca-3a61-44c9-b9e0-bb29b333f0f9 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1115, in _create_from_image\n model_update, cloned = self._prepare_image_cache_entry(\n', ' File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun\n return caller(func, *(extras + args), **kw)\n', ' File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized\n return f(*a, **k)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 894, in _prepare_image_cache_entry\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 989, in _create_from_image_cache_or_download\n self.db.volume_glance_metadata_bulk_create(\n', ' File "/opt/stack/cinder/cinder/db/api.py", line 1138, in volume_glance_metadata_bulk_create\n return IMPL.volume_glance_metadata_bulk_create(context, volume_id,\n', ' File "/opt/stack/cinder/cinder/db/sqlalchemy/api.py", line 181, in wrapper\n return f(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/db/sqlalchemy/api.py", line 211, in wrapper\n return f(context, volume_id, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1022, in wrapper\n return fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/db/sqlalchemy/api.py", line 6178, in volume_glance_metadata_bulk_create\n raise exception.GlanceMetadataExists(key=key, volume_id=volume_id)\n', 'cinder.exception.GlanceMetadataExists: Glance metadata cannot be updated, key signature_verified exists for volume id 40efe2ca-3a61-44c9-b9e0-bb29b333f0f9\n'] Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:02:58.961377 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (40efe2ca-3a61-44c9-b9e0-bb29b333f0f9) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 65, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 57, 'calculated_free_capacity': 62.0, 'virtual_free_capacity': 62.0, 'free_percent': 52.1, 'provisioned_ratio': 0.48, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/62.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:02:58.961377] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Weigher CapacityWeigher returned, weigher value is {max: 62.0, min: 62.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:00.287526 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1e1b7999-dc9b-4569-8d3f-e2ed6a4f344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Flow 'volume_create_scheduler' (24bb843d-6289-44b3-af26-5e8340cba45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Flow 'volume_create_scheduler' (ffd34950-31d5-44f3-8441-7addc8ada394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (59d99baf-1932-4ef2-b053-dbfcbd455e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (59d99baf-1932-4ef2-b053-dbfcbd455e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=c0c829d5-daba-4365-b51f-aabe77d8aa62,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(40efe2ca-3a61-44c9-b9e0-bb29b333f0f9),volume_id=40efe2ca-3a61-44c9-b9e0-bb29b333f0f9,volume_properties=VolumeProperties,volume_type=VolumeType(27e07afb-6233-4285-b990-341afc23321e))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0ca11508-0213-4009-bbab-3cf79f3bea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Error scheduling 40efe2ca-3a61-44c9-b9e0-bb29b333f0f9 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1115, in _create_from_image\n model_update, cloned = self._prepare_image_cache_entry(\n', ' File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun\n return caller(func, *(extras + args), **kw)\n', ' File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized\n return f(*a, **k)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 894, in _prepare_image_cache_entry\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 989, in _create_from_image_cache_or_download\n self.db.volume_glance_metadata_bulk_create(\n', ' File "/opt/stack/cinder/cinder/db/api.py", line 1138, in volume_glance_metadata_bulk_create\n return IMPL.volume_glance_metadata_bulk_create(context, volume_id,\n', ' File "/opt/stack/cinder/cinder/db/sqlalchemy/api.py", line 181, in wrapper\n return f(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/db/sqlalchemy/api.py", line 211, in wrapper\n return f(context, volume_id, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1022, in wrapper\n return fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/db/sqlalchemy/api.py", line 6178, in volume_glance_metadata_bulk_create\n raise exception.GlanceMetadataExists(key=key, volume_id=volume_id)\n', 'cinder.exception.GlanceMetadataExists: Glance metadata cannot be updated, key signature_verified exists for volume id 40efe2ca-3a61-44c9-b9e0-bb29b333f0f9\n'] Apr 17 16:03:01 user cinder-scheduler[84081]: INFO cinder.message.api [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Creating message record for request_id = req-9f7266e8-b4c8-475d-a860-ee39dd076d33 Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:03:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 40efe2ca-3a61-44c9-b9e0-bb29b333f0f9: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 40efe2ca-3a61-44c9-b9e0-bb29b333f0f9 Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Setting Volume 40efe2ca-3a61-44c9-b9e0-bb29b333f0f9 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 40efe2ca-3a61-44c9-b9e0-bb29b333f0f9 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0ca11508-0213-4009-bbab-3cf79f3bea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-9f7266e8-b4c8-475d-a860-ee39dd076d33 tempest-VolumeAndVolumeTypeFromImageTest-1053354066 None] Flow 'volume_create_scheduler' (ffd34950-31d5-44f3-8441-7addc8ada394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (11a2c484-fcec-43f1-9b78-eb44e980aa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (da53b224-05ad-46a3-8cf4-1dc451e4cba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (da53b224-05ad-46a3-8cf4-1dc451e4cba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc),volume_id=b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0092220c-21ae-4bb7-8592-c4523f40375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Error scheduling b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:03:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:00.287526 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 65, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 57, 'calculated_free_capacity': 62.0, 'virtual_free_capacity': 62.0, 'free_percent': 52.1, 'provisioned_ratio': 0.48, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/62.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 65, total_capacity_gb: 119, allocated_capacity_gb: 57, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 57, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:00.287526] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Weigher CapacityWeigher returned, weigher value is {max: 62.0, min: 62.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:02.021142 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0092220c-21ae-4bb7-8592-c4523f40375a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (11a2c484-fcec-43f1-9b78-eb44e980aa0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Flow 'volume_create_scheduler' (d0bfc980-364d-4919-9390-c78bb4ae107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d3970bd4-6a92-4145-9d0b-b582171dffdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d3970bd4-6a92-4145-9d0b-b582171dffdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4d960aac-48dd-470e-831f-eaafe64c9fdf),volume_id=4d960aac-48dd-470e-831f-eaafe64c9fdf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (20f6c0d9-b79e-4acc-851c-8122b9af0bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4d960aac-48dd-470e-831f-eaafe64c9fdf) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 64, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 58, 'calculated_free_capacity': 61.0, 'virtual_free_capacity': 61.0, 'free_percent': 51.26, 'provisioned_ratio': 0.49, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/61.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:02.021142] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Weigher CapacityWeigher returned, weigher value is {max: 61.0, min: 61.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:05.771025 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (20f6c0d9-b79e-4acc-851c-8122b9af0bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Flow 'volume_create_scheduler' (d0bfc980-364d-4919-9390-c78bb4ae107d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:26 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=53,cinder:UPDATE=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:03:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Flow 'volume_create_scheduler' (bdbd728a-5b40-4cf1-9c01-72bdde5b1f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3c09b74a-af33-4dfd-9782-c6a9efdfa1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3c09b74a-af33-4dfd-9782-c6a9efdfa1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff),volume_id=bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff,volume_properties=VolumeProperties,volume_type=VolumeType(c9c52f37-7390-466f-a6ab-56ae9a61e5ed))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (20c34845-268f-4fc2-98e1-5da634bf926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:26 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Error scheduling bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:03:26 user cinder-scheduler[84081]: INFO cinder.message.api [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Creating message record for request_id = req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 Apr 17 16:03:26 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:03:26 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff Apr 17 16:03:26 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Setting Volume bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource bff6fdbb-a1fb-4b48-bca8-2f7efbc3f0ff {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:03:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (20c34845-268f-4fc2-98e1-5da634bf926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-fdf1a5ca-318c-4e88-a55c-392a5c930c01 tempest-VolumeRetypeWithoutMigrationTest-683339201 None] Flow 'volume_create_scheduler' (bdbd728a-5b40-4cf1-9c01-72bdde5b1f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (2919ff24-579b-4a43-8782-75026ba439c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b9c92ead-9ab7-4022-8147-08b06f982862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b9c92ead-9ab7-4022-8147-08b06f982862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fd313648-5fc1-4e6a-97a0-92ac803b36fd),volume_id=fd313648-5fc1-4e6a-97a0-92ac803b36fd,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (23be9216-90b1-46c2-b438-a5e172fabbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:32 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Error scheduling fd313648-5fc1-4e6a-97a0-92ac803b36fd from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:05.771025 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (fd313648-5fc1-4e6a-97a0-92ac803b36fd) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 64, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 58, 'calculated_free_capacity': 61.0, 'virtual_free_capacity': 61.0, 'free_percent': 51.26, 'provisioned_ratio': 0.49, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/61.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:05.771025] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Weigher CapacityWeigher returned, weigher value is {max: 61.0, min: 61.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:32.772076 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (23be9216-90b1-46c2-b438-a5e172fabbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:32 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (2919ff24-579b-4a43-8782-75026ba439c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (efb16686-ca74-4a18-9a30-7f006ca76ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (539c690e-50c3-4a90-b36b-a0dc4e957684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (539c690e-50c3-4a90-b36b-a0dc4e957684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(63b2c7c3-8482-49d4-bb89-c4ccf3f2db82),volume_id=63b2c7c3-8482-49d4-bb89-c4ccf3f2db82,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4909c9be-6a29-4501-b619-10242ab45658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:03:38 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Error scheduling 63b2c7c3-8482-49d4-bb89-c4ccf3f2db82 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:32.772076 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (63b2c7c3-8482-49d4-bb89-c4ccf3f2db82) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 64, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 58, 'calculated_free_capacity': 61.0, 'virtual_free_capacity': 61.0, 'free_percent': 51.26, 'provisioned_ratio': 0.49, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/61.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:32.772076] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Weigher CapacityWeigher returned, weigher value is {max: 61.0, min: 61.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:38.906513 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4909c9be-6a29-4501-b619-10242ab45658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:03:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (efb16686-ca74-4a18-9a30-7f006ca76ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:04:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=31,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Flow 'volume_create_scheduler' (4edaa76e-2639-44ef-885c-9c302eea6669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f143e94d-d317-4c89-bcd2-a0b2c868c670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f143e94d-d317-4c89-bcd2-a0b2c868c670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(26014b4e-ec84-4011-a69f-ed42c3424a24),volume_id=26014b4e-ec84-4011-a69f-ed42c3424a24,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ee14266c-1e4e-48c2-b164-f00b96354330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:04:24 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Error scheduling 26014b4e-ec84-4011-a69f-ed42c3424a24 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:38.906513 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (26014b4e-ec84-4011-a69f-ed42c3424a24) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 64, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 58, 'calculated_free_capacity': 61.0, 'virtual_free_capacity': 61.0, 'free_percent': 51.26, 'provisioned_ratio': 0.49, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/61.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:03:38.906513] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Weigher CapacityWeigher returned, weigher value is {max: 61.0, min: 61.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:04:24.965168 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ee14266c-1e4e-48c2-b164-f00b96354330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:04:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Flow 'volume_create_scheduler' (4edaa76e-2639-44ef-885c-9c302eea6669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:04:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:04:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (1c65faf2-8243-489c-a424-f028fcbdcb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:04:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9e65cc9d-c345-458e-aa42-ab5d293379cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:04:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9e65cc9d-c345-458e-aa42-ab5d293379cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb),volume_id=9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:04:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9d3bea62-a122-46a3-9c36-f6ba2167e0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:04:43 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Error scheduling 9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:04:43 user cinder-scheduler[84081]: INFO cinder.message.api [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Creating message record for request_id = req-dc8764a6-903f-44ac-86a4-76a8d1914785 Apr 17 16:04:43 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:04:43 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb Apr 17 16:04:43 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Setting Volume 9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 9a399a62-6a8f-4b6d-8ecf-8dcdf57e5fbb {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:04:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9d3bea62-a122-46a3-9c36-f6ba2167e0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:04:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-dc8764a6-903f-44ac-86a4-76a8d1914785 tempest-VolumeRevertTests-63962236 None] Flow 'volume_create_scheduler' (1c65faf2-8243-489c-a424-f028fcbdcb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=5,cinder:SELECT=15,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (6bb137b8-a0a2-47ab-a90d-12edd030b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6ba8616e-32f1-44f9-a081-8cf0b9daae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6ba8616e-32f1-44f9-a081-8cf0b9daae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc),volume_id=b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0647a9c5-772d-4d2b-9999-77bf2883fd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Error scheduling b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:04:24.965168 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 64, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 58, 'calculated_free_capacity': 61.0, 'virtual_free_capacity': 61.0, 'free_percent': 51.26, 'provisioned_ratio': 0.49, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/61.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:04:24.965168] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Weigher CapacityWeigher returned, weigher value is {max: 61.0, min: 61.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:21.325028 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0647a9c5-772d-4d2b-9999-77bf2883fd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (6bb137b8-a0a2-47ab-a90d-12edd030b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Flow 'volume_create_scheduler' (0b91481d-711c-4009-b8a1-57c469d727e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (51da16a9-287e-4b93-ae26-1711d04a6649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (51da16a9-287e-4b93-ae26-1711d04a6649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4d960aac-48dd-470e-831f-eaafe64c9fdf),volume_id=4d960aac-48dd-470e-831f-eaafe64c9fdf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9cab046b-0555-4f69-a31d-b58987147ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:24 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Error scheduling 4d960aac-48dd-470e-831f-eaafe64c9fdf from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:21.325028 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4d960aac-48dd-470e-831f-eaafe64c9fdf) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 64, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 58, 'calculated_free_capacity': 61.0, 'virtual_free_capacity': 61.0, 'free_percent': 51.26, 'provisioned_ratio': 0.49, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/61.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 64, total_capacity_gb: 119, allocated_capacity_gb: 58, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 58, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:21.325028] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Weigher CapacityWeigher returned, weigher value is {max: 61.0, min: 61.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:24.385722 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9cab046b-0555-4f69-a31d-b58987147ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Flow 'volume_create_scheduler' (0b91481d-711c-4009-b8a1-57c469d727e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=8,cinder:SELECT=26 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:05:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (d7c80b8d-2ec3-44ac-9efe-65e66175f031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (600ea444-075e-41db-9249-27542fe436c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (600ea444-075e-41db-9249-27542fe436c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=b3f0dec1-7758-44a8-82e0-76ada8837428,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(fd313648-5fc1-4e6a-97a0-92ac803b36fd),volume_id=fd313648-5fc1-4e6a-97a0-92ac803b36fd,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (12bb8d72-41cc-4104-a64b-6a8f4b6ad653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:51 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Error scheduling fd313648-5fc1-4e6a-97a0-92ac803b36fd from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1237, in execute\n model_update = self._create_from_image(context,\n', ' File "/opt/stack/cinder/cinder/utils.py", line 670, in _wrapper\n return r(f, *args, **kwargs)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 423, in __call__\n do = self.iter(retry_state=retry_state)\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 360, in iter\n return fut.result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result\n return self.__get_result()\n', ' File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result\n raise self._exception\n', ' File "/usr/local/lib/python3.10/dist-packages/tenacity/__init__.py", line 426, in __call__\n result = fn(*args, **kwargs)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1125, in _create_from_image\n model_update = self._create_from_image_cache_or_download(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 944, in _create_from_image_cache_or_download\n model_update, cloned = self._create_from_image_cache(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 843, in _create_from_image_cache\n model_update = self._create_from_source_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 659, in _create_from_source_volume\n model_update = self.driver.create_cloned_volume(volume, srcvol_ref)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 525, in create_cloned_volume\n self._clone_object(vname, cvname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 461, in _clone_object\n self.ra.create_snapshot(oname, coname)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 639, in create_snapshot\n if not resp["error"] and resp["code"] in (200, 201, 204):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:05:51 user cinder-scheduler[84081]: INFO cinder.message.api [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Creating message record for request_id = req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 Apr 17 16:05:52 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:05:52 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource fd313648-5fc1-4e6a-97a0-92ac803b36fd: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource fd313648-5fc1-4e6a-97a0-92ac803b36fd Apr 17 16:05:52 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Setting Volume fd313648-5fc1-4e6a-97a0-92ac803b36fd to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource fd313648-5fc1-4e6a-97a0-92ac803b36fd {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:05:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (12bb8d72-41cc-4104-a64b-6a8f4b6ad653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-349c88aa-88c4-45fd-8d6e-2f56f9e5f4f3 tempest-TestVolumeBootPattern-1545678105 None] Flow 'volume_create_scheduler' (d7c80b8d-2ec3-44ac-9efe-65e66175f031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (77d9590f-9483-4519-9f8e-425c3b718de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83558d38-a7f7-446d-9066-c204922ba5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (83558d38-a7f7-446d-9066-c204922ba5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(65a642c3-b1e1-4b80-9bd2-f00151b6304a),volume_id=65a642c3-b1e1-4b80-9bd2-f00151b6304a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a5a3740b-c5aa-46b3-b95a-aee499a9faaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (65a642c3-b1e1-4b80-9bd2-f00151b6304a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 63, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 59, 'calculated_free_capacity': 60.0, 'virtual_free_capacity': 60.0, 'free_percent': 50.42, 'provisioned_ratio': 0.5, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/60.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:24.385722] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Weigher CapacityWeigher returned, weigher value is {max: 60.0, min: 60.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:55.544659 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a5a3740b-c5aa-46b3-b95a-aee499a9faaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:55 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (77d9590f-9483-4519-9f8e-425c3b718de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (e442fdd4-9d92-4d48-aaba-974e0cbadebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f1899ac5-0a8a-4901-8e72-9d56c9b3a61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f1899ac5-0a8a-4901-8e72-9d56c9b3a61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(63b2c7c3-8482-49d4-bb89-c4ccf3f2db82),volume_id=63b2c7c3-8482-49d4-bb89-c4ccf3f2db82,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a60c8386-2b55-41e1-875c-6e9497f017fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:05:58 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Error scheduling 63b2c7c3-8482-49d4-bb89-c4ccf3f2db82 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:55.544659 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (63b2c7c3-8482-49d4-bb89-c4ccf3f2db82) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 63, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 59, 'calculated_free_capacity': 60.0, 'virtual_free_capacity': 60.0, 'free_percent': 50.42, 'provisioned_ratio': 0.5, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/60.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:55.544659] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Weigher CapacityWeigher returned, weigher value is {max: 60.0, min: 60.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:58.224956 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a60c8386-2b55-41e1-875c-6e9497f017fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:05:58 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (e442fdd4-9d92-4d48-aaba-974e0cbadebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:06:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=34,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:06:45 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:06:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Flow 'volume_create_scheduler' (ae80fcd6-c9aa-48e8-a6b3-01126f39f9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:06:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (38234be7-d016-4205-a25f-a45bffdcd422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:06:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (38234be7-d016-4205-a25f-a45bffdcd422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(26014b4e-ec84-4011-a69f-ed42c3424a24),volume_id=26014b4e-ec84-4011-a69f-ed42c3424a24,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:06:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d35c483c-1889-4074-b347-8f286c709a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:06:45 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Error scheduling 26014b4e-ec84-4011-a69f-ed42c3424a24 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:06:45 user cinder-scheduler[84081]: INFO cinder.message.api [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Creating message record for request_id = req-8969563c-70db-45ae-8d53-74d80da7efc1 Apr 17 16:06:45 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:06:45 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 26014b4e-ec84-4011-a69f-ed42c3424a24: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 26014b4e-ec84-4011-a69f-ed42c3424a24 Apr 17 16:06:45 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Setting Volume 26014b4e-ec84-4011-a69f-ed42c3424a24 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 26014b4e-ec84-4011-a69f-ed42c3424a24 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:06:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d35c483c-1889-4074-b347-8f286c709a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:06:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8969563c-70db-45ae-8d53-74d80da7efc1 tempest-VolumesListAdminTestJSON-1808324659 None] Flow 'volume_create_scheduler' (ae80fcd6-c9aa-48e8-a6b3-01126f39f9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:07:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:07:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (2cb99f68-4711-4a24-9929-008f1b9e2dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:07:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9138938e-609f-4941-837f-89f325c4c623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:07:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9138938e-609f-4941-837f-89f325c4c623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc),volume_id=b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:07:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0f39f58d-f4b4-4358-b7f0-a079351d7775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:07:42 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Error scheduling b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:07:42 user cinder-scheduler[84081]: INFO cinder.message.api [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Creating message record for request_id = req-39f8a1bb-4b23-4f63-8942-bcd810255374 Apr 17 16:07:42 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:07:42 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc Apr 17 16:07:42 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Setting Volume b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource b4281d17-c1d8-48d3-8a0b-8fd7d2f193cc {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:07:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0f39f58d-f4b4-4358-b7f0-a079351d7775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:07:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-39f8a1bb-4b23-4f63-8942-bcd810255374 tempest-AttachVolumeShelveTestJSON-1745617049 None] Flow 'volume_create_scheduler' (2cb99f68-4711-4a24-9929-008f1b9e2dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Flow 'volume_create_scheduler' (b533a7ae-a152-4a5a-b798-4954fc12874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (277fe056-5535-4a32-aaae-534b95edc71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (277fe056-5535-4a32-aaae-534b95edc71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4d960aac-48dd-470e-831f-eaafe64c9fdf),volume_id=4d960aac-48dd-470e-831f-eaafe64c9fdf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5f219a40-9846-4c6a-8481-758286fe825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:07:45 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Error scheduling 4d960aac-48dd-470e-831f-eaafe64c9fdf from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:58.224956 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4d960aac-48dd-470e-831f-eaafe64c9fdf) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 63, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 59, 'calculated_free_capacity': 60.0, 'virtual_free_capacity': 60.0, 'free_percent': 50.42, 'provisioned_ratio': 0.5, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/60.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:05:58.224956] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Weigher CapacityWeigher returned, weigher value is {max: 60.0, min: 60.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:07:45.820846 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5f219a40-9846-4c6a-8481-758286fe825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:07:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Flow 'volume_create_scheduler' (b533a7ae-a152-4a5a-b798-4954fc12874e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:07:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=25,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (8ad6870a-b7db-4323-a7ff-e4964cb12a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ca7e52ff-e5b5-457a-be3f-7c154e8efd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ca7e52ff-e5b5-457a-be3f-7c154e8efd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(65a642c3-b1e1-4b80-9bd2-f00151b6304a),volume_id=65a642c3-b1e1-4b80-9bd2-f00151b6304a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6fb33718-f170-4792-bf6c-2d3ced1724b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:08:17 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Error scheduling 65a642c3-b1e1-4b80-9bd2-f00151b6304a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:07:45.820846 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (65a642c3-b1e1-4b80-9bd2-f00151b6304a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 63, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 59, 'calculated_free_capacity': 60.0, 'virtual_free_capacity': 60.0, 'free_percent': 50.42, 'provisioned_ratio': 0.5, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/60.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 63, total_capacity_gb: 119, allocated_capacity_gb: 59, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 59, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:07:45.820846] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Weigher CapacityWeigher returned, weigher value is {max: 60.0, min: 60.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:08:17.421055 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6fb33718-f170-4792-bf6c-2d3ced1724b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:08:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (8ad6870a-b7db-4323-a7ff-e4964cb12a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:08:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (1b873d1f-f6bc-4a3a-a189-da4ea251b577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:08:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b8306b54-f2a1-4b8d-8f9e-08a5fb11b921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:08:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b8306b54-f2a1-4b8d-8f9e-08a5fb11b921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(63b2c7c3-8482-49d4-bb89-c4ccf3f2db82),volume_id=63b2c7c3-8482-49d4-bb89-c4ccf3f2db82,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:08:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (505978bb-14be-4860-8790-b2dec4446596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:08:20 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Error scheduling 63b2c7c3-8482-49d4-bb89-c4ccf3f2db82 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:08:20 user cinder-scheduler[84081]: INFO cinder.message.api [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Creating message record for request_id = req-a293a946-8aa4-47bc-8290-fe9922d7ae21 Apr 17 16:08:20 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:08:20 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 63b2c7c3-8482-49d4-bb89-c4ccf3f2db82: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 63b2c7c3-8482-49d4-bb89-c4ccf3f2db82 Apr 17 16:08:20 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Setting Volume 63b2c7c3-8482-49d4-bb89-c4ccf3f2db82 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 63b2c7c3-8482-49d4-bb89-c4ccf3f2db82 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:08:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (505978bb-14be-4860-8790-b2dec4446596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:08:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a293a946-8aa4-47bc-8290-fe9922d7ae21 tempest-AttachVolumeNegativeTest-331389537 None] Flow 'volume_create_scheduler' (1b873d1f-f6bc-4a3a-a189-da4ea251b577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:08:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=7,cinder:SELECT=23,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:08:17.421055] {{(pid=84081) _get_weighted_candidates_by_group_type /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:529}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Weigher CapacityWeigher returned, weigher value is {max: 59.0, min: 59.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:08:17.421055] {{(pid=84081) _get_weighted_candidates_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:436}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Weigher CapacityWeigher returned, weigher value is {max: 59.0, min: 59.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:08:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-989d7e12-21bd-4d79-b382-2b050fa61450 tempest-GroupsV320Test-1696456310 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:604}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=5,cinder:SELECT=15 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (e0119904-97ae-4c7c-be2a-9506c965f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (50bf3563-6090-4301-a31a-160d7747e289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (50bf3563-6090-4301-a31a-160d7747e289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(49effcda-e787-4983-92b2-f8261052732d),volume_id=49effcda-e787-4983-92b2-f8261052732d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (faf46e92-8fe8-4f5a-9439-f8c63d06b71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (49effcda-e787-4983-92b2-f8261052732d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 62, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 60, 'calculated_free_capacity': 59.0, 'virtual_free_capacity': 59.0, 'free_percent': 49.58, 'provisioned_ratio': 0.5, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/59.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:08:17.421055] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Weigher CapacityWeigher returned, weigher value is {max: 59.0, min: 59.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 61, total_capacity_gb: 119, allocated_capacity_gb: 61, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 61, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:08:57.788658 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (faf46e92-8fe8-4f5a-9439-f8c63d06b71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:08:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (e0119904-97ae-4c7c-be2a-9506c965f26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:09:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:10:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Flow 'volume_create_scheduler' (aecbbb1b-f675-4eb3-9d89-cf19ee2af6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:10:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (99da19dc-8c8a-4153-82d1-332d59e7183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:10:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (99da19dc-8c8a-4153-82d1-332d59e7183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4d960aac-48dd-470e-831f-eaafe64c9fdf),volume_id=4d960aac-48dd-470e-831f-eaafe64c9fdf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:10:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f52cb909-d77f-47ab-93dc-820dcd7567cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:10:04 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Error scheduling 4d960aac-48dd-470e-831f-eaafe64c9fdf from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:10:04 user cinder-scheduler[84081]: INFO cinder.message.api [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Creating message record for request_id = req-2f261810-f79c-48b0-b0ef-2727c4b52668 Apr 17 16:10:04 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:10:04 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 4d960aac-48dd-470e-831f-eaafe64c9fdf: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 4d960aac-48dd-470e-831f-eaafe64c9fdf Apr 17 16:10:04 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Setting Volume 4d960aac-48dd-470e-831f-eaafe64c9fdf to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 4d960aac-48dd-470e-831f-eaafe64c9fdf {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:10:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f52cb909-d77f-47ab-93dc-820dcd7567cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:10:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2f261810-f79c-48b0-b0ef-2727c4b52668 tempest-VolumesListTestJSON-659728137 None] Flow 'volume_create_scheduler' (aecbbb1b-f675-4eb3-9d89-cf19ee2af6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:10:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=18,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (36c93d08-b9f8-4223-a236-c7d6e8354c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (be9ce1a1-bac8-47f6-a192-410808077b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (be9ce1a1-bac8-47f6-a192-410808077b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(65a642c3-b1e1-4b80-9bd2-f00151b6304a),volume_id=65a642c3-b1e1-4b80-9bd2-f00151b6304a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f3cb32c8-2f4f-4ec9-ab68-d8ea64496581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:10:36 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Error scheduling 65a642c3-b1e1-4b80-9bd2-f00151b6304a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:08:57.788658 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (65a642c3-b1e1-4b80-9bd2-f00151b6304a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 62, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 60, 'calculated_free_capacity': 59.0, 'virtual_free_capacity': 59.0, 'free_percent': 49.58, 'provisioned_ratio': 0.5, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/59.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:08:57.788658] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Weigher CapacityWeigher returned, weigher value is {max: 59.0, min: 59.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 61, total_capacity_gb: 119, allocated_capacity_gb: 61, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 61, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:10:36.546561 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f3cb32c8-2f4f-4ec9-ab68-d8ea64496581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:10:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (36c93d08-b9f8-4223-a236-c7d6e8354c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:10:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (b2c4dd2a-3973-4dc5-a093-5af2eafceee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b4fb01e5-289e-4af9-b40f-f946cb0a1d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b4fb01e5-289e-4af9-b40f-f946cb0a1d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(49effcda-e787-4983-92b2-f8261052732d),volume_id=49effcda-e787-4983-92b2-f8261052732d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2ce01551-75fc-4959-a3d9-03984caa2108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:11:16 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Error scheduling 49effcda-e787-4983-92b2-f8261052732d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:10:36.546561 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (49effcda-e787-4983-92b2-f8261052732d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 62, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 60, 'calculated_free_capacity': 59.0, 'virtual_free_capacity': 59.0, 'free_percent': 49.58, 'provisioned_ratio': 0.5, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/59.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 62, total_capacity_gb: 119, allocated_capacity_gb: 60, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 60, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:10:36.546561] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Weigher CapacityWeigher returned, weigher value is {max: 59.0, min: 59.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 61, total_capacity_gb: 119, allocated_capacity_gb: 61, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 61, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:11:16.790448 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2ce01551-75fc-4959-a3d9-03984caa2108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:11:16 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (b2c4dd2a-3973-4dc5-a093-5af2eafceee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Flow 'volume_create_scheduler' (d3a947e8-2d1b-4ca3-a8d6-fe20ef129837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fd128df5-e219-43f4-b3df-ec1f97b18917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (fd128df5-e219-43f4-b3df-ec1f97b18917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0a7d4209-92e0-4900-8e98-36a62e68c247),volume_id=0a7d4209-92e0-4900-8e98-36a62e68c247,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bde18345-b6eb-4078-a68f-cc2f1c49fedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (0a7d4209-92e0-4900-8e98-36a62e68c247) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 61, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 61, 'calculated_free_capacity': 58.0, 'virtual_free_capacity': 58.0, 'free_percent': 48.74, 'provisioned_ratio': 0.51, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/58.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 61, total_capacity_gb: 119, allocated_capacity_gb: 61, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 61, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:11:16.790448] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Weigher CapacityWeigher returned, weigher value is {max: 58.0, min: 58.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 60, total_capacity_gb: 119, allocated_capacity_gb: 62, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 62, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:11:18.052218 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bde18345-b6eb-4078-a68f-cc2f1c49fedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:11:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Flow 'volume_create_scheduler' (d3a947e8-2d1b-4ca3-a8d6-fe20ef129837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Flow 'volume_create_scheduler' (e395174e-27e7-4a08-ad5e-8932041bc621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9a67a645-3195-4e14-ba63-96f56808b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9a67a645-3195-4e14-ba63-96f56808b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(85fcb006-cd96-4018-b0e3-04872ff08267),volume_id=85fcb006-cd96-4018-b0e3-04872ff08267,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9a97a10f-a4ec-4206-9c80-1a30f56813d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (85fcb006-cd96-4018-b0e3-04872ff08267) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 60, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 62, 'calculated_free_capacity': 57.0, 'virtual_free_capacity': 57.0, 'free_percent': 47.9, 'provisioned_ratio': 0.52, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/57.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 60, total_capacity_gb: 119, allocated_capacity_gb: 62, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 62, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:11:18.052218] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Weigher CapacityWeigher returned, weigher value is {max: 57.0, min: 57.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 59, total_capacity_gb: 119, allocated_capacity_gb: 63, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 63, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:11:28.478027 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9a97a10f-a4ec-4206-9c80-1a30f56813d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:11:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Flow 'volume_create_scheduler' (e395174e-27e7-4a08-ad5e-8932041bc621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:11:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=39,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (b9ab3fa9-73cf-448b-8d1c-eab505824d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2b17728d-7015-4c65-8654-c98f8a430191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2b17728d-7015-4c65-8654-c98f8a430191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf4c0b13-49c6-4b1d-b790-7090eb82d4c4),volume_id=bf4c0b13-49c6-4b1d-b790-7090eb82d4c4,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f3b1ca7c-92a1-45ea-844b-50cb520ec4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bf4c0b13-49c6-4b1d-b790-7090eb82d4c4) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 59, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 63, 'calculated_free_capacity': 56.0, 'virtual_free_capacity': 56.0, 'free_percent': 47.06, 'provisioned_ratio': 0.53, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/56.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 59, total_capacity_gb: 119, allocated_capacity_gb: 63, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 63, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:11:28.478027] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Weigher CapacityWeigher returned, weigher value is {max: 56.0, min: 56.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:11:57.378515 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f3b1ca7c-92a1-45ea-844b-50cb520ec4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:11:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (b9ab3fa9-73cf-448b-8d1c-eab505824d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (6b2dc7e3-891a-403c-a227-2f210e697f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a09bfea1-5ff7-4e5f-a039-80632cf79ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a09bfea1-5ff7-4e5f-a039-80632cf79ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(125cc0cd-98dc-41a8-a252-3ae03797fb6f),volume_id=125cc0cd-98dc-41a8-a252-3ae03797fb6f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (374d2015-bdfd-4690-a6f5-99a08a5d5de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (125cc0cd-98dc-41a8-a252-3ae03797fb6f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 58, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 64, 'calculated_free_capacity': 55.0, 'virtual_free_capacity': 55.0, 'free_percent': 46.22, 'provisioned_ratio': 0.54, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/55.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:11:57.378515] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Weigher CapacityWeigher returned, weigher value is {max: 55.0, min: 55.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:12:13 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:12:13.982112 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:12:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (374d2015-bdfd-4690-a6f5-99a08a5d5de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:12:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (6b2dc7e3-891a-403c-a227-2f210e697f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:12:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=34,cinder:UPDATE=8 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:12:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (541443d7-1e26-4961-ab0e-c25782a32fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:12:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (29fec958-3a02-4ff1-bd1a-042e886217ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:12:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (29fec958-3a02-4ff1-bd1a-042e886217ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(65a642c3-b1e1-4b80-9bd2-f00151b6304a),volume_id=65a642c3-b1e1-4b80-9bd2-f00151b6304a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:12:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (148eafcc-941f-475d-bc5a-80bf195aa4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:12:56 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Error scheduling 65a642c3-b1e1-4b80-9bd2-f00151b6304a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:12:56 user cinder-scheduler[84081]: INFO cinder.message.api [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Creating message record for request_id = req-251ec93b-05ae-4736-ab3c-338a5d9efb63 Apr 17 16:12:56 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:12:56 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 65a642c3-b1e1-4b80-9bd2-f00151b6304a: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 65a642c3-b1e1-4b80-9bd2-f00151b6304a Apr 17 16:12:56 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Setting Volume 65a642c3-b1e1-4b80-9bd2-f00151b6304a to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 65a642c3-b1e1-4b80-9bd2-f00151b6304a {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:12:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (148eafcc-941f-475d-bc5a-80bf195aa4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:12:56 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-251ec93b-05ae-4736-ab3c-338a5d9efb63 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (541443d7-1e26-4961-ab0e-c25782a32fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:13:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:13:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Flow 'volume_create_scheduler' (352d3a40-50f7-4259-826f-17f8291de7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0cbf0931-82d3-49ca-99f5-9aa3a76a665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0cbf0931-82d3-49ca-99f5-9aa3a76a665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0a7d4209-92e0-4900-8e98-36a62e68c247),volume_id=0a7d4209-92e0-4900-8e98-36a62e68c247,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0fa73d64-ff9e-4298-a7c3-754e3372d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:13:35 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Error scheduling 0a7d4209-92e0-4900-8e98-36a62e68c247 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:12:13.982112 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (53d7ac75-6c5f-4826-9ff6-c9415ce86365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e58c4bbf-db89-48c5-be63-1393fff8fc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e58c4bbf-db89-48c5-be63-1393fff8fc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(49effcda-e787-4983-92b2-f8261052732d),volume_id=49effcda-e787-4983-92b2-f8261052732d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d4694058-bec7-4289-8efd-904eec197b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:13:35 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Error scheduling 49effcda-e787-4983-92b2-f8261052732d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 59, total_capacity_gb: 119, allocated_capacity_gb: 63, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 63, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:12:13.982112 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (0a7d4209-92e0-4900-8e98-36a62e68c247) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 59, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 63, 'calculated_free_capacity': 56.0, 'virtual_free_capacity': 56.0, 'free_percent': 47.06, 'provisioned_ratio': 0.53, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/56.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 59, total_capacity_gb: 119, allocated_capacity_gb: 63, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 63, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:12:13.982112] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Weigher CapacityWeigher returned, weigher value is {max: 56.0, min: 56.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:13:35.714409 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (49effcda-e787-4983-92b2-f8261052732d) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 58, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 64, 'calculated_free_capacity': 55.0, 'virtual_free_capacity': 55.0, 'free_percent': 46.22, 'provisioned_ratio': 0.54, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/55.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:13:35.714409] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Weigher CapacityWeigher returned, weigher value is {max: 55.0, min: 55.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:13:35.728494 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d4694058-bec7-4289-8efd-904eec197b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (53d7ac75-6c5f-4826-9ff6-c9415ce86365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0fa73d64-ff9e-4298-a7c3-754e3372d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:13:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Flow 'volume_create_scheduler' (352d3a40-50f7-4259-826f-17f8291de7b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Flow 'volume_create_scheduler' (bbd242c0-c24e-4a0a-8f75-bd371816300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7a18bbba-64b3-4380-9e9a-3bcf7fa8660a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7a18bbba-64b3-4380-9e9a-3bcf7fa8660a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(85fcb006-cd96-4018-b0e3-04872ff08267),volume_id=85fcb006-cd96-4018-b0e3-04872ff08267,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (59f93b6b-2ba1-4e60-bbf4-1900190fa938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:13:44 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Error scheduling 85fcb006-cd96-4018-b0e3-04872ff08267 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:13:35.728494 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (85fcb006-cd96-4018-b0e3-04872ff08267) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 58, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 64, 'calculated_free_capacity': 55.0, 'virtual_free_capacity': 55.0, 'free_percent': 46.22, 'provisioned_ratio': 0.54, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/55.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:13:35.728494] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Weigher CapacityWeigher returned, weigher value is {max: 55.0, min: 55.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:13:44.813773 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (59f93b6b-2ba1-4e60-bbf4-1900190fa938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:13:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Flow 'volume_create_scheduler' (bbd242c0-c24e-4a0a-8f75-bd371816300b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:14:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=9,cinder:SELECT=32 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (8264bca8-eb62-4d69-9dc1-8fc04dbef7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e85fcbb4-f55b-4f90-99da-ca2970fbd74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e85fcbb4-f55b-4f90-99da-ca2970fbd74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf4c0b13-49c6-4b1d-b790-7090eb82d4c4),volume_id=bf4c0b13-49c6-4b1d-b790-7090eb82d4c4,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (28aae3ff-63c7-452e-91d3-97d0ae194266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:14:15 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Error scheduling bf4c0b13-49c6-4b1d-b790-7090eb82d4c4 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:13:44.813773 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bf4c0b13-49c6-4b1d-b790-7090eb82d4c4) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 58, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 64, 'calculated_free_capacity': 55.0, 'virtual_free_capacity': 55.0, 'free_percent': 46.22, 'provisioned_ratio': 0.54, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/55.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:13:44.813773] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Weigher CapacityWeigher returned, weigher value is {max: 55.0, min: 55.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:15.554986 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (28aae3ff-63c7-452e-91d3-97d0ae194266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:14:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (8264bca8-eb62-4d69-9dc1-8fc04dbef7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (482c2e6b-24db-40c4-9aef-6d0b7b8eef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a5948ada-ddf8-4fdd-8835-ac5567f2856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a5948ada-ddf8-4fdd-8835-ac5567f2856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(125cc0cd-98dc-41a8-a252-3ae03797fb6f),volume_id=125cc0cd-98dc-41a8-a252-3ae03797fb6f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a7a3010f-3bef-42e4-b07c-ff6dfa5f73e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:14:33 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Error scheduling 125cc0cd-98dc-41a8-a252-3ae03797fb6f from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:15.554986 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (125cc0cd-98dc-41a8-a252-3ae03797fb6f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 58, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 64, 'calculated_free_capacity': 55.0, 'virtual_free_capacity': 55.0, 'free_percent': 46.22, 'provisioned_ratio': 0.54, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/55.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 58, total_capacity_gb: 119, allocated_capacity_gb: 64, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 64, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:15.554986] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Weigher CapacityWeigher returned, weigher value is {max: 55.0, min: 55.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:33.961471 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a7a3010f-3bef-42e4-b07c-ff6dfa5f73e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:14:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (482c2e6b-24db-40c4-9aef-6d0b7b8eef9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:14:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=26,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:33.961471] {{(pid=84081) _get_weighted_candidates_by_group_type /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:529}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 54.0, min: 54.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:33.961471] {{(pid=84081) _get_weighted_candidates_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:436}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 54.0, min: 54.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:14:46 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8a4be074-8e3d-42a9-aae8-4a9dcdb6498b tempest-GroupsTest-789764105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:604}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:33.961471] {{(pid=84081) _get_weighted_candidates_by_group_type /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:529}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 54.0, min: 54.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:33.961471] {{(pid=84081) _get_weighted_candidates_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:436}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 54.0, min: 54.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:14:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-75d1bffa-cc99-439c-98ef-55fbfbaee58f tempest-GroupsTest-789764105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:604}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (34327ba0-a4fe-4eec-b32a-267dea0317ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ae1bdd60-26fc-4088-a938-7d576f5702c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ae1bdd60-26fc-4088-a938-7d576f5702c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=07829a92-7f87-41a0-ad0d-04c53bb24b30,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ae1eb1a7-8e56-418f-9032-a464645060fe),volume_id=ae1eb1a7-8e56-418f-9032-a464645060fe,volume_properties=VolumeProperties,volume_type=VolumeType(39cee13b-7a8b-43bd-ae52-5d071608f5ab))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (61d4d4f8-abd0-49d2-a396-51d5c77c6189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (ae1eb1a7-8e56-418f-9032-a464645060fe) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 57, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 65, 'calculated_free_capacity': 54.0, 'virtual_free_capacity': 54.0, 'free_percent': 45.38, 'provisioned_ratio': 0.55, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/54.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 57, total_capacity_gb: 119, allocated_capacity_gb: 65, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 65, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:33.961471] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 54.0, min: 54.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:14:48 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:48.999590 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:14:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (61d4d4f8-abd0-49d2-a396-51d5c77c6189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:14:49 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (34327ba0-a4fe-4eec-b32a-267dea0317ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:15:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=7,cinder:SELECT=28 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (f6d91131-ecba-46ac-b430-bc567b72b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8fe54364-f21a-41de-b0af-c10bf5536ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8fe54364-f21a-41de-b0af-c10bf5536ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4725fbeb-e869-48db-a487-33998b955f83),volume_id=4725fbeb-e869-48db-a487-33998b955f83,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ab4a904c-9a58-484d-8250-bc97ba0232d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4725fbeb-e869-48db-a487-33998b955f83) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 56, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 66, 'calculated_free_capacity': 53.0, 'virtual_free_capacity': 53.0, 'free_percent': 44.54, 'provisioned_ratio': 0.55, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/53.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:14:48.999590] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Weigher CapacityWeigher returned, weigher value is {max: 53.0, min: 53.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 55, total_capacity_gb: 119, allocated_capacity_gb: 67, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 67, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:15:34.498252 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ab4a904c-9a58-484d-8250-bc97ba0232d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (f6d91131-ecba-46ac-b430-bc567b72b070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:15:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Flow 'volume_create_scheduler' (b86a5bec-a76a-428c-848c-18670e1ea5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (618eb515-c156-4abc-8454-d64cea5a25ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (618eb515-c156-4abc-8454-d64cea5a25ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0a7d4209-92e0-4900-8e98-36a62e68c247),volume_id=0a7d4209-92e0-4900-8e98-36a62e68c247,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8d825a02-553b-4efd-accc-54ef76ff89e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:15:54 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Error scheduling 0a7d4209-92e0-4900-8e98-36a62e68c247 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:15:34.498252 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (2ff1661b-0a84-474f-8512-93310a06956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (21cdee7a-ca14-472d-b976-3eed5ec3a539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (21cdee7a-ca14-472d-b976-3eed5ec3a539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(49effcda-e787-4983-92b2-f8261052732d),volume_id=49effcda-e787-4983-92b2-f8261052732d,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac0da373-ce8b-4073-8a99-412bb7386a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:15:54 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Error scheduling 49effcda-e787-4983-92b2-f8261052732d from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:15:54 user cinder-scheduler[84081]: INFO cinder.message.api [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Creating message record for request_id = req-40e48e44-d46b-4e9d-82c5-3b795728a90d Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (0a7d4209-92e0-4900-8e98-36a62e68c247) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 56, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 66, 'calculated_free_capacity': 53.0, 'virtual_free_capacity': 53.0, 'free_percent': 44.54, 'provisioned_ratio': 0.55, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/53.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:15:34.498252] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Weigher CapacityWeigher returned, weigher value is {max: 53.0, min: 53.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 55, total_capacity_gb: 119, allocated_capacity_gb: 67, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 67, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:15:54.929684 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:15:54 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 49effcda-e787-4983-92b2-f8261052732d: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 49effcda-e787-4983-92b2-f8261052732d Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Setting Volume 49effcda-e787-4983-92b2-f8261052732d to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 49effcda-e787-4983-92b2-f8261052732d {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ac0da373-ce8b-4073-8a99-412bb7386a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-40e48e44-d46b-4e9d-82c5-3b795728a90d tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (2ff1661b-0a84-474f-8512-93310a06956f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8d825a02-553b-4efd-accc-54ef76ff89e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:15:54 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Flow 'volume_create_scheduler' (b86a5bec-a76a-428c-848c-18670e1ea5f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Flow 'volume_create_scheduler' (dac2a5c8-fdd1-4e65-96e7-95b5d2f28a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9e320240-6b45-442f-9efb-8d1be15da314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9e320240-6b45-442f-9efb-8d1be15da314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(85fcb006-cd96-4018-b0e3-04872ff08267),volume_id=85fcb006-cd96-4018-b0e3-04872ff08267,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (841cd17a-f96d-44f1-8932-9eac49c4a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:16:03 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Error scheduling 85fcb006-cd96-4018-b0e3-04872ff08267 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:15:54.929684 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (85fcb006-cd96-4018-b0e3-04872ff08267) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 56, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 66, 'calculated_free_capacity': 53.0, 'virtual_free_capacity': 53.0, 'free_percent': 44.54, 'provisioned_ratio': 0.55, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/53.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:15:54.929684] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Weigher CapacityWeigher returned, weigher value is {max: 53.0, min: 53.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:16:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 55, total_capacity_gb: 119, allocated_capacity_gb: 67, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 67, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:16:03.987716 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:16:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (841cd17a-f96d-44f1-8932-9eac49c4a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:16:04 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Flow 'volume_create_scheduler' (dac2a5c8-fdd1-4e65-96e7-95b5d2f28a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:16:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=31,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:16:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (564a3a27-14bb-4f0e-a010-6f87c2f28567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c2959b9c-a617-40fd-b848-77f4914811ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c2959b9c-a617-40fd-b848-77f4914811ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf4c0b13-49c6-4b1d-b790-7090eb82d4c4),volume_id=bf4c0b13-49c6-4b1d-b790-7090eb82d4c4,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8edb7a5-9762-4357-82b2-9496f84cd79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:16:35 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Error scheduling bf4c0b13-49c6-4b1d-b790-7090eb82d4c4 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:16:03.987716 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bf4c0b13-49c6-4b1d-b790-7090eb82d4c4) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 56, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 66, 'calculated_free_capacity': 53.0, 'virtual_free_capacity': 53.0, 'free_percent': 44.54, 'provisioned_ratio': 0.55, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/53.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:16:03.987716] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Weigher CapacityWeigher returned, weigher value is {max: 53.0, min: 53.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 55, total_capacity_gb: 119, allocated_capacity_gb: 67, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 67, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:16:35.408806 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f8edb7a5-9762-4357-82b2-9496f84cd79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:16:35 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (564a3a27-14bb-4f0e-a010-6f87c2f28567) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (ab25de91-94d7-445b-847e-40675bec758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ea13344f-0dd2-403a-9b73-3012f7155a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ea13344f-0dd2-403a-9b73-3012f7155a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(125cc0cd-98dc-41a8-a252-3ae03797fb6f),volume_id=125cc0cd-98dc-41a8-a252-3ae03797fb6f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6acc12ab-e989-4a91-8582-57e1f1ca1b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:16:50 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Error scheduling 125cc0cd-98dc-41a8-a252-3ae03797fb6f from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:16:35.408806 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (125cc0cd-98dc-41a8-a252-3ae03797fb6f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 56, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 66, 'calculated_free_capacity': 53.0, 'virtual_free_capacity': 53.0, 'free_percent': 44.54, 'provisioned_ratio': 0.55, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/53.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:16:35.408806] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Weigher CapacityWeigher returned, weigher value is {max: 53.0, min: 53.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 55, total_capacity_gb: 119, allocated_capacity_gb: 67, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 67, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:16:50.739734 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6acc12ab-e989-4a91-8582-57e1f1ca1b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:16:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (ab25de91-94d7-445b-847e-40675bec758f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:17:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=7,cinder:SELECT=25 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (79a53812-741a-4a71-be77-2762844761ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (88f8367e-3b06-4b79-9669-d6a40f279211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (88f8367e-3b06-4b79-9669-d6a40f279211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=07829a92-7f87-41a0-ad0d-04c53bb24b30,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ae1eb1a7-8e56-418f-9032-a464645060fe),volume_id=ae1eb1a7-8e56-418f-9032-a464645060fe,volume_properties=VolumeProperties,volume_type=VolumeType(39cee13b-7a8b-43bd-ae52-5d071608f5ab))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (df9a5de5-cf76-429d-bf21-b538d9ddc5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:17:06 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Error scheduling ae1eb1a7-8e56-418f-9032-a464645060fe from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:16:50.739734 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (ae1eb1a7-8e56-418f-9032-a464645060fe) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 56, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 66, 'calculated_free_capacity': 53.0, 'virtual_free_capacity': 53.0, 'free_percent': 44.54, 'provisioned_ratio': 0.55, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/53.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:16:50.739734] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 53.0, min: 53.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 55, total_capacity_gb: 119, allocated_capacity_gb: 67, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 67, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:17:06.834490 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (df9a5de5-cf76-429d-bf21-b538d9ddc5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:17:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (79a53812-741a-4a71-be77-2762844761ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:17:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=5,cinder:SELECT=17 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (a95fe5eb-fbf0-4947-93d4-76bed0d68fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b339e239-76f1-4d0d-8a98-d64d5530d2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b339e239-76f1-4d0d-8a98-d64d5530d2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4725fbeb-e869-48db-a487-33998b955f83),volume_id=4725fbeb-e869-48db-a487-33998b955f83,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0a808316-5771-4986-b816-61307cdef68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:17:53 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Error scheduling 4725fbeb-e869-48db-a487-33998b955f83 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:17:06.834490 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4725fbeb-e869-48db-a487-33998b955f83) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 56, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 66, 'calculated_free_capacity': 53.0, 'virtual_free_capacity': 53.0, 'free_percent': 44.54, 'provisioned_ratio': 0.55, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/53.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 56, total_capacity_gb: 119, allocated_capacity_gb: 66, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 66, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:17:06.834490] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Weigher CapacityWeigher returned, weigher value is {max: 53.0, min: 53.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 55, total_capacity_gb: 119, allocated_capacity_gb: 67, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 67, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:17:53.847258 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0a808316-5771-4986-b816-61307cdef68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:17:53 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (a95fe5eb-fbf0-4947-93d4-76bed0d68fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Flow 'volume_create_scheduler' (d810ec14-6797-4810-afca-2db2ca6b1576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4a78d231-fd16-42ad-91a3-0f6560cef211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (4a78d231-fd16-42ad-91a3-0f6560cef211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c9fa0a17-69d4-40d0-9d65-af6ae349cfd8),volume_id=c9fa0a17-69d4-40d0-9d65-af6ae349cfd8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aa42e6e2-764b-4fd1-8343-d1d144e726d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (c9fa0a17-69d4-40d0-9d65-af6ae349cfd8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 55, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 67, 'calculated_free_capacity': 52.0, 'virtual_free_capacity': 52.0, 'free_percent': 43.7, 'provisioned_ratio': 0.56, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/52.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 55, total_capacity_gb: 119, allocated_capacity_gb: 67, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 67, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:17:53.847258] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Weigher CapacityWeigher returned, weigher value is {max: 52.0, min: 52.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 54, total_capacity_gb: 119, allocated_capacity_gb: 68, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 68, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:18:00.082186 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aa42e6e2-764b-4fd1-8343-d1d144e726d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Flow 'volume_create_scheduler' (d810ec14-6797-4810-afca-2db2ca6b1576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=7,cinder:SELECT=28 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 54, total_capacity_gb: 119, allocated_capacity_gb: 68, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 68, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:18:00.082186] {{(pid=84081) _get_weighted_candidates_by_group_type /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:529}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Weigher CapacityWeigher returned, weigher value is {max: 51.0, min: 51.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 54, total_capacity_gb: 119, allocated_capacity_gb: 68, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 68, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:18:00.082186] {{(pid=84081) _get_weighted_candidates_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:436}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Weigher CapacityWeigher returned, weigher value is {max: 51.0, min: 51.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:18:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-164aa17b-5907-464e-b650-af56f916c2ea tempest-GroupsV314Test-467284027 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:604}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Flow 'volume_create_scheduler' (b6feb2b4-344f-4130-bb96-4d65cc0a12f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bba0be14-a048-4f93-8f10-40ac6a9db69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bba0be14-a048-4f93-8f10-40ac6a9db69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=f28ccf81-6553-4a98-83d7-400266578051,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7f7b3b2e-e41d-466a-a3c2-e64e3d63b949),volume_id=7f7b3b2e-e41d-466a-a3c2-e64e3d63b949,volume_properties=VolumeProperties,volume_type=VolumeType(be5f492b-b41f-4ad5-bffd-42eaafb454b4))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (85c82552-db79-4bdb-8b61-e0797541f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7f7b3b2e-e41d-466a-a3c2-e64e3d63b949) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 54, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 68, 'calculated_free_capacity': 51.0, 'virtual_free_capacity': 51.0, 'free_percent': 42.86, 'provisioned_ratio': 0.57, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/51.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 54, total_capacity_gb: 119, allocated_capacity_gb: 68, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 68, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:18:00.082186] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Weigher CapacityWeigher returned, weigher value is {max: 51.0, min: 51.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:18:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:18:07.984609 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:18:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (85c82552-db79-4bdb-8b61-e0797541f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Flow 'volume_create_scheduler' (b6feb2b4-344f-4130-bb96-4d65cc0a12f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Flow 'volume_create_scheduler' (f46519dc-9f23-453b-91bd-f59958649819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a76e956-0328-453c-baa3-7eb5ede22c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a76e956-0328-453c-baa3-7eb5ede22c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(0a7d4209-92e0-4900-8e98-36a62e68c247),volume_id=0a7d4209-92e0-4900-8e98-36a62e68c247,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4abd70bf-dd46-42f8-90e7-3a37d25479da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:15 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Error scheduling 0a7d4209-92e0-4900-8e98-36a62e68c247 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:18:15 user cinder-scheduler[84081]: INFO cinder.message.api [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Creating message record for request_id = req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 Apr 17 16:18:15 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:18:15 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 0a7d4209-92e0-4900-8e98-36a62e68c247: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 0a7d4209-92e0-4900-8e98-36a62e68c247 Apr 17 16:18:15 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Setting Volume 0a7d4209-92e0-4900-8e98-36a62e68c247 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 0a7d4209-92e0-4900-8e98-36a62e68c247 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:18:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4abd70bf-dd46-42f8-90e7-3a37d25479da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:15 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-482d9d54-8fe6-4470-94f4-7e368edd2a1a req-530db70f-e58e-4ff0-ae5f-4bc68b7f2df1 tempest-VolumesGetTestJSON-223039682 None] Flow 'volume_create_scheduler' (f46519dc-9f23-453b-91bd-f59958649819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Flow 'volume_create_scheduler' (80bdc3e1-f37b-4bbb-8f28-121c593fe6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0f64f5f5-91ad-40f6-bc9e-a5a281410b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0f64f5f5-91ad-40f6-bc9e-a5a281410b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(85fcb006-cd96-4018-b0e3-04872ff08267),volume_id=85fcb006-cd96-4018-b0e3-04872ff08267,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (50772c17-329f-4a11-b275-70a5b54f4e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:24 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Error scheduling 85fcb006-cd96-4018-b0e3-04872ff08267 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:18:24 user cinder-scheduler[84081]: INFO cinder.message.api [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Creating message record for request_id = req-726a1377-a691-4c8a-a56d-8b87aed706f7 Apr 17 16:18:24 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:18:24 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 85fcb006-cd96-4018-b0e3-04872ff08267: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 85fcb006-cd96-4018-b0e3-04872ff08267 Apr 17 16:18:24 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Setting Volume 85fcb006-cd96-4018-b0e3-04872ff08267 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 85fcb006-cd96-4018-b0e3-04872ff08267 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:18:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (50772c17-329f-4a11-b275-70a5b54f4e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [req-03b99b1c-6c29-4a54-8914-aee31ee083b6 req-726a1377-a691-4c8a-a56d-8b87aed706f7 tempest-VolumesSnapshotsTestJSON-2126874200 None] Flow 'volume_create_scheduler' (80bdc3e1-f37b-4bbb-8f28-121c593fe6f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=10,cinder:SELECT=37,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (b07bce8b-f180-451c-826f-98735477fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1b88b63a-2f69-43ea-9c90-c0e752626e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1b88b63a-2f69-43ea-9c90-c0e752626e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b900713d-b991-43a5-b403-483dfded7e11),volume_id=b900713d-b991-43a5-b403-483dfded7e11,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e19610e2-db0f-43ec-9885-355db52a45e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b900713d-b991-43a5-b403-483dfded7e11) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 53, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 69, 'calculated_free_capacity': 50.0, 'virtual_free_capacity': 50.0, 'free_percent': 42.02, 'provisioned_ratio': 0.58, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/50.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:18:07.984609] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Weigher CapacityWeigher returned, weigher value is {max: 50.0, min: 50.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:18:51.314868 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e19610e2-db0f-43ec-9885-355db52a45e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:51 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (b07bce8b-f180-451c-826f-98735477fee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (daaabcf6-411f-4a7e-8356-48e7fd632350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:18:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7117f6dd-8d1f-41a2-b051-c4d7eaa0d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7117f6dd-8d1f-41a2-b051-c4d7eaa0d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf4c0b13-49c6-4b1d-b790-7090eb82d4c4),volume_id=bf4c0b13-49c6-4b1d-b790-7090eb82d4c4,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9931317c-a154-44d5-85b2-6ab892a1e75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:18:52 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Error scheduling bf4c0b13-49c6-4b1d-b790-7090eb82d4c4 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:18:52 user cinder-scheduler[84081]: INFO cinder.message.api [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Creating message record for request_id = req-e76412e0-459f-4be5-bc08-e01e70270c82 Apr 17 16:18:52 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:18:52 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource bf4c0b13-49c6-4b1d-b790-7090eb82d4c4: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource bf4c0b13-49c6-4b1d-b790-7090eb82d4c4 Apr 17 16:18:52 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Setting Volume bf4c0b13-49c6-4b1d-b790-7090eb82d4c4 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource bf4c0b13-49c6-4b1d-b790-7090eb82d4c4 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:18:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9931317c-a154-44d5-85b2-6ab892a1e75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:18:52 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-e76412e0-459f-4be5-bc08-e01e70270c82 tempest-AttachVolumeTestJSON-1193954556 None] Flow 'volume_create_scheduler' (daaabcf6-411f-4a7e-8356-48e7fd632350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:19:10 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=8,cinder:SELECT=27,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:19:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (addce193-84d6-4e4f-a9ce-11d509772fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:19:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3973b032-31b4-4430-8df2-e2d5639c999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:19:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3973b032-31b4-4430-8df2-e2d5639c999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(125cc0cd-98dc-41a8-a252-3ae03797fb6f),volume_id=125cc0cd-98dc-41a8-a252-3ae03797fb6f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:19:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (af98287d-87b7-4b9e-8be6-f87cad0c9c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:19:10 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Error scheduling 125cc0cd-98dc-41a8-a252-3ae03797fb6f from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:19:10 user cinder-scheduler[84081]: INFO cinder.message.api [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Creating message record for request_id = req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc Apr 17 16:19:10 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:19:10 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 125cc0cd-98dc-41a8-a252-3ae03797fb6f: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 125cc0cd-98dc-41a8-a252-3ae03797fb6f Apr 17 16:19:10 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Setting Volume 125cc0cd-98dc-41a8-a252-3ae03797fb6f to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 125cc0cd-98dc-41a8-a252-3ae03797fb6f {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:19:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (af98287d-87b7-4b9e-8be6-f87cad0c9c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:19:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-c6a1a049-a5f6-42d9-8682-cac7fc8587cc tempest-VolumesTransfersV355Test-39117650 None] Flow 'volume_create_scheduler' (addce193-84d6-4e4f-a9ce-11d509772fa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (6513c438-e2f1-4e67-8ae2-c8a6f5955211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c1b04169-ebd2-48b2-8a80-9798d94ddc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c1b04169-ebd2-48b2-8a80-9798d94ddc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=07829a92-7f87-41a0-ad0d-04c53bb24b30,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ae1eb1a7-8e56-418f-9032-a464645060fe),volume_id=ae1eb1a7-8e56-418f-9032-a464645060fe,volume_properties=VolumeProperties,volume_type=VolumeType(39cee13b-7a8b-43bd-ae52-5d071608f5ab))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7bd9d109-4b87-4beb-ab17-bee29d22a5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:19:26 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Error scheduling ae1eb1a7-8e56-418f-9032-a464645060fe from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:18:51.314868 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (ae1eb1a7-8e56-418f-9032-a464645060fe) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 53, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 69, 'calculated_free_capacity': 50.0, 'virtual_free_capacity': 50.0, 'free_percent': 42.02, 'provisioned_ratio': 0.58, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/50.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:18:51.314868] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 50.0, min: 50.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:19:26.077769 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7bd9d109-4b87-4beb-ab17-bee29d22a5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (6513c438-e2f1-4e67-8ae2-c8a6f5955211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Flow 'volume_create_scheduler' (7a6249da-1433-490b-8c18-537142568406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (af320c49-f25f-4904-a98a-e46c920cb0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (af320c49-f25f-4904-a98a-e46c920cb0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(06938941-bae4-4015-bdbe-cee388f7b235),volume_id=06938941-bae4-4015-bdbe-cee388f7b235,volume_properties=VolumeProperties,volume_type=VolumeType(14b36082-336f-4528-a65f-1678f9677960))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (911ac817-63e1-43f8-bd38-a6a1e7a88769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (06938941-bae4-4015-bdbe-cee388f7b235) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 52, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 70, 'calculated_free_capacity': 49.0, 'virtual_free_capacity': 49.0, 'free_percent': 41.18, 'provisioned_ratio': 0.59, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/49.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capabilities_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Volume type extra spec requirement "storage_protocol=tempest-storage_protocol-1371575366" does not match reported capability "['iSCSI', 'iscsi']" {{(pid=84081) _satisfies_extra_specs /opt/stack/cinder/cinder/scheduler/filters/capabilities_filter.py:86}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capabilities_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:19:26.077769 fails resource_type extra_specs requirements {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capabilities_filter.py:100}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Filtering removed all hosts for the request with volume ID '06938941-bae4-4015-bdbe-cee388f7b235'. Filter results: [('AvailabilityZoneFilter', ['user@joviandss-2#joviandss-2']), ('CapacityFilter', ['user@joviandss-2#joviandss-2']), ('CapabilitiesFilter', [])] {{(pid=84081) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Apr 17 16:19:26 user cinder-scheduler[84081]: INFO cinder.scheduler.base_filter [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Filtering removed all hosts for the request with volume ID '06938941-bae4-4015-bdbe-cee388f7b235'. Filter results: AvailabilityZoneFilter: (start: 1, end: 1), CapacityFilter: (start: 1, end: 1), CapabilitiesFilter: (start: 1, end: 0) Apr 17 16:19:26 user cinder-scheduler[84081]: WARNING cinder.scheduler.filter_scheduler [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] No weighed backend found for volume with properties: {'id': '14b36082-336f-4528-a65f-1678f9677960', 'name': 'tempest-UserMessagesTest-volume-type-750589044', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-1371575366', 'vendor_name': 'tempest-vendor_name-2065147085'}, 'qos_specs_id': None, 'created_at': '2023-04-17T16:19:26.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Apr 17 16:19:26 user cinder-scheduler[84081]: INFO cinder.message.api [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Creating message record for request_id = req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 Apr 17 16:19:26 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Setting Volume 06938941-bae4-4015-bdbe-cee388f7b235 to error due to: No valid backend was found. No weighed backends available {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (911ac817-63e1-43f8-bd38-a6a1e7a88769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:19:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1bcd2fb5-cff0-4523-adbf-93cb1291ad47 tempest-UserMessagesTest-1394518079 None] Flow 'volume_create_scheduler' (7a6249da-1433-490b-8c18-537142568406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Flow 'volume_create_scheduler' (fd0305f7-1c81-4fb6-add0-8b36115ebce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (87f2235e-82c4-475f-ab5c-5a4833b97207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (87f2235e-82c4-475f-ab5c-5a4833b97207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(9986e86e-82cb-4be1-9d68-d6704cfeab36),volume_id=9986e86e-82cb-4be1-9d68-d6704cfeab36,volume_properties=VolumeProperties,volume_type=VolumeType(a94db67e-d6a9-48e1-b785-3337f01f0870))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1a800e0d-8dc8-46ce-b571-d12549d6eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (9986e86e-82cb-4be1-9d68-d6704cfeab36) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 52, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 70, 'calculated_free_capacity': 49.0, 'virtual_free_capacity': 49.0, 'free_percent': 41.18, 'provisioned_ratio': 0.59, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/49.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capabilities_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Volume type extra spec requirement "storage_protocol=tempest-storage_protocol-1644070418" does not match reported capability "['iSCSI', 'iscsi']" {{(pid=84081) _satisfies_extra_specs /opt/stack/cinder/cinder/scheduler/filters/capabilities_filter.py:86}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capabilities_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:19:26.077769 fails resource_type extra_specs requirements {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capabilities_filter.py:100}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Filter CapabilitiesFilter returned 0 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Filtering removed all hosts for the request with volume ID '9986e86e-82cb-4be1-9d68-d6704cfeab36'. Filter results: [('AvailabilityZoneFilter', ['user@joviandss-2#joviandss-2']), ('CapacityFilter', ['user@joviandss-2#joviandss-2']), ('CapabilitiesFilter', [])] {{(pid=84081) _log_filtration /opt/stack/cinder/cinder/scheduler/base_filter.py:73}} Apr 17 16:19:28 user cinder-scheduler[84081]: INFO cinder.scheduler.base_filter [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Filtering removed all hosts for the request with volume ID '9986e86e-82cb-4be1-9d68-d6704cfeab36'. Filter results: AvailabilityZoneFilter: (start: 1, end: 1), CapacityFilter: (start: 1, end: 1), CapabilitiesFilter: (start: 1, end: 0) Apr 17 16:19:28 user cinder-scheduler[84081]: WARNING cinder.scheduler.filter_scheduler [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] No weighed backend found for volume with properties: {'id': 'a94db67e-d6a9-48e1-b785-3337f01f0870', 'name': 'tempest-UserMessagesTest-volume-type-855023546', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'storage_protocol': 'tempest-storage_protocol-1644070418', 'vendor_name': 'tempest-vendor_name-976673709'}, 'qos_specs_id': None, 'created_at': '2023-04-17T16:19:28.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False} Apr 17 16:19:28 user cinder-scheduler[84081]: INFO cinder.message.api [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Creating message record for request_id = req-2366a964-742f-4397-9283-2dc863bfb4e9 Apr 17 16:19:28 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. No weighed backends available: cinder.exception.NoValidBackend: No valid backend was found. No weighed backends available Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Setting Volume 9986e86e-82cb-4be1-9d68-d6704cfeab36 to error due to: No valid backend was found. No weighed backends available {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (1a800e0d-8dc8-46ce-b571-d12549d6eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:19:28 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-2366a964-742f-4397-9283-2dc863bfb4e9 tempest-UserMessagesTest-1394518079 None] Flow 'volume_create_scheduler' (fd0305f7-1c81-4fb6-add0-8b36115ebce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:19:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=45,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (134476a8-1d46-4583-aa0e-40c5dbecb91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (41833124-d135-4529-bd30-9444c03cfc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (41833124-d135-4529-bd30-9444c03cfc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4725fbeb-e869-48db-a487-33998b955f83),volume_id=4725fbeb-e869-48db-a487-33998b955f83,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (60e618ae-9630-4360-acbc-4e6a3d7ab254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:20:12 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Error scheduling 4725fbeb-e869-48db-a487-33998b955f83 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:19:26.077769 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (4725fbeb-e869-48db-a487-33998b955f83) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 53, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 69, 'calculated_free_capacity': 50.0, 'virtual_free_capacity': 50.0, 'free_percent': 42.02, 'provisioned_ratio': 0.58, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/50.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:19:26.077769] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Weigher CapacityWeigher returned, weigher value is {max: 50.0, min: 50.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:20:12.933196 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (60e618ae-9630-4360-acbc-4e6a3d7ab254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:20:12 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (134476a8-1d46-4583-aa0e-40c5dbecb91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:20:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:20:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Flow 'volume_create_scheduler' (a31312ce-7682-4cae-8053-d15cc6354f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:20:18 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c4d37a2e-4dbe-456e-8b0d-f62a19e3f57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c4d37a2e-4dbe-456e-8b0d-f62a19e3f57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c9fa0a17-69d4-40d0-9d65-af6ae349cfd8),volume_id=c9fa0a17-69d4-40d0-9d65-af6ae349cfd8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (012d3764-4ed1-4f98-8d78-7d454da79378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:20:19 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Error scheduling c9fa0a17-69d4-40d0-9d65-af6ae349cfd8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:20:12.933196 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (c9fa0a17-69d4-40d0-9d65-af6ae349cfd8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 53, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 69, 'calculated_free_capacity': 50.0, 'virtual_free_capacity': 50.0, 'free_percent': 42.02, 'provisioned_ratio': 0.58, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/50.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:20:12.933196] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Weigher CapacityWeigher returned, weigher value is {max: 50.0, min: 50.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:20:19.021621 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (012d3764-4ed1-4f98-8d78-7d454da79378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:20:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Flow 'volume_create_scheduler' (a31312ce-7682-4cae-8053-d15cc6354f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Flow 'volume_create_scheduler' (b3517c62-faf4-4a03-ae1d-b44c7b4452b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a26820d-ca89-413b-98bc-4241e778c7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (2a26820d-ca89-413b-98bc-4241e778c7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=f28ccf81-6553-4a98-83d7-400266578051,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7f7b3b2e-e41d-466a-a3c2-e64e3d63b949),volume_id=7f7b3b2e-e41d-466a-a3c2-e64e3d63b949,volume_properties=VolumeProperties,volume_type=VolumeType(be5f492b-b41f-4ad5-bffd-42eaafb454b4))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9bed95f3-d345-4a5d-aaca-d6b8a981a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:20:25 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Error scheduling 7f7b3b2e-e41d-466a-a3c2-e64e3d63b949 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:20:19.021621 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7f7b3b2e-e41d-466a-a3c2-e64e3d63b949) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 53, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 69, 'calculated_free_capacity': 50.0, 'virtual_free_capacity': 50.0, 'free_percent': 42.02, 'provisioned_ratio': 0.58, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/50.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:20:19.021621] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Weigher CapacityWeigher returned, weigher value is {max: 50.0, min: 50.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:20:25.190692 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (9bed95f3-d345-4a5d-aaca-d6b8a981a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:20:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Flow 'volume_create_scheduler' (b3517c62-faf4-4a03-ae1d-b44c7b4452b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:20:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=25,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (bff12d9d-c838-407e-807d-a50661883d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3026668a-9811-4a99-902b-8bf15564a8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3026668a-9811-4a99-902b-8bf15564a8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b900713d-b991-43a5-b403-483dfded7e11),volume_id=b900713d-b991-43a5-b403-483dfded7e11,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (94e20a55-039a-4656-a237-9b4d2f83cf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:21:08 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Error scheduling b900713d-b991-43a5-b403-483dfded7e11 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:20:25.190692 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b900713d-b991-43a5-b403-483dfded7e11) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 53, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 69, 'calculated_free_capacity': 50.0, 'virtual_free_capacity': 50.0, 'free_percent': 42.02, 'provisioned_ratio': 0.58, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/50.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 53, total_capacity_gb: 119, allocated_capacity_gb: 69, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 69, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:20:25.190692] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Weigher CapacityWeigher returned, weigher value is {max: 50.0, min: 50.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:21:08.233320 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (94e20a55-039a-4656-a237-9b4d2f83cf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:21:08 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (bff12d9d-c838-407e-807d-a50661883d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:21:08.233320] {{(pid=84081) _get_weighted_candidates_by_group_type /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:529}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 49.0, min: 49.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 0 GB volume (None) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:21:08.233320] {{(pid=84081) _get_weighted_candidates_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:436}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 49.0, min: 49.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-14569ee4-fd22-4f97-ac17-cb6ac7a50989 tempest-GroupsTest-789764105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend_generic_group /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:604}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Flow 'volume_create_scheduler' (df601889-2b19-4f62-ba15-dd9833ca990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (56ac57c1-7e76-4b01-ab9d-8bc0ce22b13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (56ac57c1-7e76-4b01-ab9d-8bc0ce22b13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(94610127-c8b8-4df4-9e39-a1f41b5a9b98),volume_id=94610127-c8b8-4df4-9e39-a1f41b5a9b98,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f5e18fbd-4740-4b3e-963d-a99c99580203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (94610127-c8b8-4df4-9e39-a1f41b5a9b98) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 52, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 70, 'calculated_free_capacity': 49.0, 'virtual_free_capacity': 49.0, 'free_percent': 41.18, 'provisioned_ratio': 0.59, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/49.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 52, total_capacity_gb: 119, allocated_capacity_gb: 70, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 70, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:21:08.233320] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Weigher CapacityWeigher returned, weigher value is {max: 49.0, min: 49.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:21:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 51, total_capacity_gb: 119, allocated_capacity_gb: 71, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 71, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:21:23.975274 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (f5e18fbd-4740-4b3e-963d-a99c99580203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Flow 'volume_create_scheduler' (df601889-2b19-4f62-ba15-dd9833ca990c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (6a8b754f-b152-422d-9901-fba7d190a2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (de8b3daf-ca71-4d83-8224-02979459c34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (de8b3daf-ca71-4d83-8224-02979459c34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=fe50cd00-dcd4-4b21-a4e9-6f226f8c6ac1,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(02aba338-fa31-4e46-8fcf-7f86191e44d1),volume_id=02aba338-fa31-4e46-8fcf-7f86191e44d1,volume_properties=VolumeProperties,volume_type=VolumeType(400bec8d-bd01-4057-8fb8-49a786cd39f1))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (998babcc-636a-4e89-9d85-742bd796c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (02aba338-fa31-4e46-8fcf-7f86191e44d1) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 51, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 71, 'calculated_free_capacity': 48.0, 'virtual_free_capacity': 48.0, 'free_percent': 40.34, 'provisioned_ratio': 0.6, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/48.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 51, total_capacity_gb: 119, allocated_capacity_gb: 71, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 71, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:21:23.975274] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 48.0, min: 48.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:21:24.796818 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (998babcc-636a-4e89-9d85-742bd796c01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:21:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (6a8b754f-b152-422d-9901-fba7d190a2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:21:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (70ee38d0-4dc1-4850-a369-b01e0f2551e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:21:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (363241bf-a759-4b96-a227-69d77e4240ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:21:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (363241bf-a759-4b96-a227-69d77e4240ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=07829a92-7f87-41a0-ad0d-04c53bb24b30,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(ae1eb1a7-8e56-418f-9032-a464645060fe),volume_id=ae1eb1a7-8e56-418f-9032-a464645060fe,volume_properties=VolumeProperties,volume_type=VolumeType(39cee13b-7a8b-43bd-ae52-5d071608f5ab))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:21:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (971d82b0-51c7-4fae-ab02-51746513b7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:21:45 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Error scheduling ae1eb1a7-8e56-418f-9032-a464645060fe from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:21:45 user cinder-scheduler[84081]: INFO cinder.message.api [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Creating message record for request_id = req-5a436bf3-8843-4b13-8b6b-92ee59a23185 Apr 17 16:21:45 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:21:45 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource ae1eb1a7-8e56-418f-9032-a464645060fe: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource ae1eb1a7-8e56-418f-9032-a464645060fe Apr 17 16:21:45 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Setting Volume ae1eb1a7-8e56-418f-9032-a464645060fe to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource ae1eb1a7-8e56-418f-9032-a464645060fe {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:21:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (971d82b0-51c7-4fae-ab02-51746513b7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:21:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-5a436bf3-8843-4b13-8b6b-92ee59a23185 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (70ee38d0-4dc1-4850-a369-b01e0f2551e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:21:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=42,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Flow 'volume_create_scheduler' (5c65ffe6-40d2-44db-a5ca-334c71959b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a7eeb5fd-d661-4343-ad2b-5a23b4095791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a7eeb5fd-d661-4343-ad2b-5a23b4095791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2e8580be-c7f2-4d3a-9007-d192a5b029b3),volume_id=2e8580be-c7f2-4d3a-9007-d192a5b029b3,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (500532eb-3263-4304-bc85-f323de5c251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2e8580be-c7f2-4d3a-9007-d192a5b029b3) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 50, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 72, 'calculated_free_capacity': 47.0, 'virtual_free_capacity': 47.0, 'free_percent': 39.5, 'provisioned_ratio': 0.61, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/47.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:21:24.796818] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Weigher CapacityWeigher returned, weigher value is {max: 47.0, min: 47.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 49, total_capacity_gb: 119, allocated_capacity_gb: 73, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 73, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:22:11.421756 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (500532eb-3263-4304-bc85-f323de5c251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:22:11 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Flow 'volume_create_scheduler' (5c65ffe6-40d2-44db-a5ca-334c71959b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:22:33 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=23,cinder:UPDATE=6 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:22:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (39cb8a32-b5fb-413b-b27c-69b23365082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:22:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1bad5e35-b2a3-41db-adfd-727321062b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:22:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1bad5e35-b2a3-41db-adfd-727321062b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(4725fbeb-e869-48db-a487-33998b955f83),volume_id=4725fbeb-e869-48db-a487-33998b955f83,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:22:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (adf30ec1-0ca0-4eb5-a1c2-fc37707672f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:22:33 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Error scheduling 4725fbeb-e869-48db-a487-33998b955f83 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:22:33 user cinder-scheduler[84081]: INFO cinder.message.api [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Creating message record for request_id = req-86e82c7b-2d41-4c71-a488-5361f4ac7ada Apr 17 16:22:33 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:22:33 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 4725fbeb-e869-48db-a487-33998b955f83: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 4725fbeb-e869-48db-a487-33998b955f83 Apr 17 16:22:33 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Setting Volume 4725fbeb-e869-48db-a487-33998b955f83 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 4725fbeb-e869-48db-a487-33998b955f83 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:22:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (adf30ec1-0ca0-4eb5-a1c2-fc37707672f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:22:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-86e82c7b-2d41-4c71-a488-5361f4ac7ada tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (39cb8a32-b5fb-413b-b27c-69b23365082e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Flow 'volume_create_scheduler' (66dc780c-5229-4edb-a8ac-c5922ef9ebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (827dbc5d-c48d-4292-a411-0f0b3b6c5227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (827dbc5d-c48d-4292-a411-0f0b3b6c5227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c9fa0a17-69d4-40d0-9d65-af6ae349cfd8),volume_id=c9fa0a17-69d4-40d0-9d65-af6ae349cfd8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4b0ccda6-a01e-4e47-8710-21e64c3911cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:22:39 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Error scheduling c9fa0a17-69d4-40d0-9d65-af6ae349cfd8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:22:11.421756 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (c9fa0a17-69d4-40d0-9d65-af6ae349cfd8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 50, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 72, 'calculated_free_capacity': 47.0, 'virtual_free_capacity': 47.0, 'free_percent': 39.5, 'provisioned_ratio': 0.61, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/47.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:22:11.421756] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Weigher CapacityWeigher returned, weigher value is {max: 47.0, min: 47.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 49, total_capacity_gb: 119, allocated_capacity_gb: 73, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 73, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:22:39.777204 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4b0ccda6-a01e-4e47-8710-21e64c3911cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:22:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Flow 'volume_create_scheduler' (66dc780c-5229-4edb-a8ac-c5922ef9ebb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Flow 'volume_create_scheduler' (ca38af52-edaf-44cb-a6fb-0f19c79def7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (15b23244-9d1a-4b57-a237-25b0eb38398d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (15b23244-9d1a-4b57-a237-25b0eb38398d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=f28ccf81-6553-4a98-83d7-400266578051,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7f7b3b2e-e41d-466a-a3c2-e64e3d63b949),volume_id=7f7b3b2e-e41d-466a-a3c2-e64e3d63b949,volume_properties=VolumeProperties,volume_type=VolumeType(be5f492b-b41f-4ad5-bffd-42eaafb454b4))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (71150069-2800-4027-b85e-47c83534ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:22:45 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Error scheduling 7f7b3b2e-e41d-466a-a3c2-e64e3d63b949 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:22:39.777204 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7f7b3b2e-e41d-466a-a3c2-e64e3d63b949) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 50, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 72, 'calculated_free_capacity': 47.0, 'virtual_free_capacity': 47.0, 'free_percent': 39.5, 'provisioned_ratio': 0.61, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/47.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:22:39.777204] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Weigher CapacityWeigher returned, weigher value is {max: 47.0, min: 47.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 49, total_capacity_gb: 119, allocated_capacity_gb: 73, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 73, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:22:45.910065 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (71150069-2800-4027-b85e-47c83534ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:22:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Flow 'volume_create_scheduler' (ca38af52-edaf-44cb-a6fb-0f19c79def7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:23:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=31,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (9f573436-ffeb-460e-b5fd-819eecc2f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (79033c9e-c6ed-43af-9d66-f78f70fa42ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (79033c9e-c6ed-43af-9d66-f78f70fa42ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b900713d-b991-43a5-b403-483dfded7e11),volume_id=b900713d-b991-43a5-b403-483dfded7e11,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c9cc734e-4d21-4782-b454-a6658c7fe4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:23:26 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Error scheduling b900713d-b991-43a5-b403-483dfded7e11 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:22:45.910065 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b900713d-b991-43a5-b403-483dfded7e11) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 50, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 72, 'calculated_free_capacity': 47.0, 'virtual_free_capacity': 47.0, 'free_percent': 39.5, 'provisioned_ratio': 0.61, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/47.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:22:45.910065] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Weigher CapacityWeigher returned, weigher value is {max: 47.0, min: 47.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 49, total_capacity_gb: 119, allocated_capacity_gb: 73, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 73, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:23:26.506830 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c9cc734e-4d21-4782-b454-a6658c7fe4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:23:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (9f573436-ffeb-460e-b5fd-819eecc2f022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Flow 'volume_create_scheduler' (632f7cb0-9cda-48ff-9e72-cc3d005355c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f8017832-be55-42fc-b7ba-bd5708cd2ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f8017832-be55-42fc-b7ba-bd5708cd2ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(94610127-c8b8-4df4-9e39-a1f41b5a9b98),volume_id=94610127-c8b8-4df4-9e39-a1f41b5a9b98,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (68a197a6-432e-4fb9-8b41-9ec4e88c4db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:23:42 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Error scheduling 94610127-c8b8-4df4-9e39-a1f41b5a9b98 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:23:26.506830 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (94610127-c8b8-4df4-9e39-a1f41b5a9b98) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 50, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 72, 'calculated_free_capacity': 47.0, 'virtual_free_capacity': 47.0, 'free_percent': 39.5, 'provisioned_ratio': 0.61, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/47.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:23:26.506830] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Weigher CapacityWeigher returned, weigher value is {max: 47.0, min: 47.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 49, total_capacity_gb: 119, allocated_capacity_gb: 73, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 73, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:23:42.244812 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (5f62ac95-b358-49e4-af57-a27a3c5ac03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d759865e-3ec5-44b3-818c-95df0b5a9b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d759865e-3ec5-44b3-818c-95df0b5a9b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=fe50cd00-dcd4-4b21-a4e9-6f226f8c6ac1,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(02aba338-fa31-4e46-8fcf-7f86191e44d1),volume_id=02aba338-fa31-4e46-8fcf-7f86191e44d1,volume_properties=VolumeProperties,volume_type=VolumeType(400bec8d-bd01-4057-8fb8-49a786cd39f1))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4efdbadb-827e-4914-a33e-a725fd9ca396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:23:42 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Error scheduling 02aba338-fa31-4e46-8fcf-7f86191e44d1 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:23:42.244812 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (02aba338-fa31-4e46-8fcf-7f86191e44d1) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 50, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 72, 'calculated_free_capacity': 47.0, 'virtual_free_capacity': 47.0, 'free_percent': 39.5, 'provisioned_ratio': 0.61, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/47.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:23:42.244812] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 47.0, min: 47.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 49, total_capacity_gb: 119, allocated_capacity_gb: 73, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 73, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:23:42.297977 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (68a197a6-432e-4fb9-8b41-9ec4e88c4db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Flow 'volume_create_scheduler' (632f7cb0-9cda-48ff-9e72-cc3d005355c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4efdbadb-827e-4914-a33e-a725fd9ca396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:23:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (5f62ac95-b358-49e4-af57-a27a3c5ac03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:24:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=25,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Flow 'volume_create_scheduler' (c3542ec4-49cc-46b7-a3f0-2ad127e4735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (623a6915-6efe-468c-8907-02c8655bdf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (623a6915-6efe-468c-8907-02c8655bdf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2e8580be-c7f2-4d3a-9007-d192a5b029b3),volume_id=2e8580be-c7f2-4d3a-9007-d192a5b029b3,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (08b84d04-3674-4317-9437-9c654d4a7359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:24:29 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Error scheduling 2e8580be-c7f2-4d3a-9007-d192a5b029b3 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:23:42.297977 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2e8580be-c7f2-4d3a-9007-d192a5b029b3) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 50, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 72, 'calculated_free_capacity': 47.0, 'virtual_free_capacity': 47.0, 'free_percent': 39.5, 'provisioned_ratio': 0.61, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/47.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 50, total_capacity_gb: 119, allocated_capacity_gb: 72, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 72, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:23:42.297977] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Weigher CapacityWeigher returned, weigher value is {max: 47.0, min: 47.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 49, total_capacity_gb: 119, allocated_capacity_gb: 73, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 73, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:24:29.092646 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (08b84d04-3674-4317-9437-9c654d4a7359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:24:29 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Flow 'volume_create_scheduler' (c3542ec4-49cc-46b7-a3f0-2ad127e4735f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (02a7c392-ce0a-441c-9443-c5d801e94ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b77eda92-b45d-458d-a75a-064862b311c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b77eda92-b45d-458d-a75a-064862b311c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(53029faa-77b2-467d-8a64-eb5ef129e41c),volume_id=53029faa-77b2-467d-8a64-eb5ef129e41c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (683c274b-eec8-4409-8109-4bcf0118ed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (53029faa-77b2-467d-8a64-eb5ef129e41c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 49, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 73, 'calculated_free_capacity': 46.0, 'virtual_free_capacity': 46.0, 'free_percent': 38.66, 'provisioned_ratio': 0.61, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/46.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 49, total_capacity_gb: 119, allocated_capacity_gb: 73, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 73, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:24:29.092646] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Weigher CapacityWeigher returned, weigher value is {max: 46.0, min: 46.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:24:42.152408 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (683c274b-eec8-4409-8109-4bcf0118ed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:24:42 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (02a7c392-ce0a-441c-9443-c5d801e94ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:24:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=30,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Flow 'volume_create_scheduler' (b613ec44-a798-47c8-bfb3-b2b2a88e5889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (174f0664-2729-4e6d-b3ac-1aaabcfe2003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (174f0664-2729-4e6d-b3ac-1aaabcfe2003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(35a67ca3-0f17-4a6c-a359-9173ce5f1aca),volume_id=35a67ca3-0f17-4a6c-a359-9173ce5f1aca,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4d25ed59-735b-4f97-8ff6-71d4ed92682f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (35a67ca3-0f17-4a6c-a359-9173ce5f1aca) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 48, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 74, 'calculated_free_capacity': 45.0, 'virtual_free_capacity': 45.0, 'free_percent': 37.82, 'provisioned_ratio': 0.62, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/45.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:24:42.152408] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Weigher CapacityWeigher returned, weigher value is {max: 45.0, min: 45.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 47, total_capacity_gb: 119, allocated_capacity_gb: 75, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 75, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:24:45.334294 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4d25ed59-735b-4f97-8ff6-71d4ed92682f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:24:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Flow 'volume_create_scheduler' (b613ec44-a798-47c8-bfb3-b2b2a88e5889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Flow 'volume_create_scheduler' (baf7f7c4-9885-4390-a8a6-7eeafa79b13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (de64675a-eea0-491e-8921-38c97e6f9833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (de64675a-eea0-491e-8921-38c97e6f9833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(c9fa0a17-69d4-40d0-9d65-af6ae349cfd8),volume_id=c9fa0a17-69d4-40d0-9d65-af6ae349cfd8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c5f63084-694a-4f09-b76f-22e22b7e64ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:24:59 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Error scheduling c9fa0a17-69d4-40d0-9d65-af6ae349cfd8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:24:59 user cinder-scheduler[84081]: INFO cinder.message.api [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Creating message record for request_id = req-f436a31c-1175-4e56-a839-11ba99c1cd60 Apr 17 16:24:59 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:24:59 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource c9fa0a17-69d4-40d0-9d65-af6ae349cfd8: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource c9fa0a17-69d4-40d0-9d65-af6ae349cfd8 Apr 17 16:24:59 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Setting Volume c9fa0a17-69d4-40d0-9d65-af6ae349cfd8 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource c9fa0a17-69d4-40d0-9d65-af6ae349cfd8 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (c5f63084-694a-4f09-b76f-22e22b7e64ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:24:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f436a31c-1175-4e56-a839-11ba99c1cd60 tempest-VolumeSnapshotQuotasNegativeTestJSON-101904959 None] Flow 'volume_create_scheduler' (baf7f7c4-9885-4390-a8a6-7eeafa79b13e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:25:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Flow 'volume_create_scheduler' (314d52af-71e7-4edc-8f66-80b4f17f1629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:25:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ee1eb4a5-dfd8-447c-9440-8acb416479c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:25:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ee1eb4a5-dfd8-447c-9440-8acb416479c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=f28ccf81-6553-4a98-83d7-400266578051,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7f7b3b2e-e41d-466a-a3c2-e64e3d63b949),volume_id=7f7b3b2e-e41d-466a-a3c2-e64e3d63b949,volume_properties=VolumeProperties,volume_type=VolumeType(be5f492b-b41f-4ad5-bffd-42eaafb454b4))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:25:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (90a2b229-e6db-4c20-8c93-85b133edd8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:25:05 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Error scheduling 7f7b3b2e-e41d-466a-a3c2-e64e3d63b949 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:25:05 user cinder-scheduler[84081]: INFO cinder.message.api [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Creating message record for request_id = req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 Apr 17 16:25:05 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:25:05 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 7f7b3b2e-e41d-466a-a3c2-e64e3d63b949: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 7f7b3b2e-e41d-466a-a3c2-e64e3d63b949 Apr 17 16:25:05 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Setting Volume 7f7b3b2e-e41d-466a-a3c2-e64e3d63b949 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 7f7b3b2e-e41d-466a-a3c2-e64e3d63b949 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:25:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (90a2b229-e6db-4c20-8c93-85b133edd8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:25:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-88db98a2-70e9-4d55-ae40-2f2cdaa2d051 tempest-GroupsV314Test-467284027 None] Flow 'volume_create_scheduler' (314d52af-71e7-4edc-8f66-80b4f17f1629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:25:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=10,cinder:SELECT=33,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:25:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (a00537ec-47a8-4ea2-af99-8a4814f91093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:25:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bf89a3a7-6def-4456-a4c3-d69f3a7f06eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:25:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bf89a3a7-6def-4456-a4c3-d69f3a7f06eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b900713d-b991-43a5-b403-483dfded7e11),volume_id=b900713d-b991-43a5-b403-483dfded7e11,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:25:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a0f9ef45-5437-4ae1-acb8-f4b49606a743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:25:47 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Error scheduling b900713d-b991-43a5-b403-483dfded7e11 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:25:47 user cinder-scheduler[84081]: INFO cinder.message.api [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Creating message record for request_id = req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf Apr 17 16:25:47 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:25:47 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource b900713d-b991-43a5-b403-483dfded7e11: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource b900713d-b991-43a5-b403-483dfded7e11 Apr 17 16:25:47 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Setting Volume b900713d-b991-43a5-b403-483dfded7e11 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource b900713d-b991-43a5-b403-483dfded7e11 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:25:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a0f9ef45-5437-4ae1-acb8-f4b49606a743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:25:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-1f5f4be7-f5ce-44e1-9d40-d669e0a61ddf tempest-VolumesTransfersV357Test-333017112 None] Flow 'volume_create_scheduler' (a00537ec-47a8-4ea2-af99-8a4814f91093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:25:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (9d2861a9-dc18-437c-bf6a-0532daa70e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5c0cb0ef-b063-401c-97d3-2cd163414e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5c0cb0ef-b063-401c-97d3-2cd163414e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=fe50cd00-dcd4-4b21-a4e9-6f226f8c6ac1,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(02aba338-fa31-4e46-8fcf-7f86191e44d1),volume_id=02aba338-fa31-4e46-8fcf-7f86191e44d1,volume_properties=VolumeProperties,volume_type=VolumeType(400bec8d-bd01-4057-8fb8-49a786cd39f1))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2795ae16-07f1-4b84-8ee4-63499cf77be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:26:02 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Error scheduling 02aba338-fa31-4e46-8fcf-7f86191e44d1 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:24:45.334294 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (02aba338-fa31-4e46-8fcf-7f86191e44d1) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 48, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 74, 'calculated_free_capacity': 45.0, 'virtual_free_capacity': 45.0, 'free_percent': 37.82, 'provisioned_ratio': 0.62, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/45.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:24:45.334294] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Weigher CapacityWeigher returned, weigher value is {max: 45.0, min: 45.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 47, total_capacity_gb: 119, allocated_capacity_gb: 75, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 75, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:02.803015 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Flow 'volume_create_scheduler' (ee319785-f753-405f-a726-60dc78b560d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1e608102-be2e-472c-90d6-15e46b7b9430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1e608102-be2e-472c-90d6-15e46b7b9430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(94610127-c8b8-4df4-9e39-a1f41b5a9b98),volume_id=94610127-c8b8-4df4-9e39-a1f41b5a9b98,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b354389-731d-487b-b841-ca9149ecef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:26:02 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Error scheduling 94610127-c8b8-4df4-9e39-a1f41b5a9b98 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:02.803015 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (94610127-c8b8-4df4-9e39-a1f41b5a9b98) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 48, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 74, 'calculated_free_capacity': 45.0, 'virtual_free_capacity': 45.0, 'free_percent': 37.82, 'provisioned_ratio': 0.62, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/45.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:02.803015] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Weigher CapacityWeigher returned, weigher value is {max: 45.0, min: 45.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 47, total_capacity_gb: 119, allocated_capacity_gb: 75, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 75, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:02.855490 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (2795ae16-07f1-4b84-8ee4-63499cf77be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (9d2861a9-dc18-437c-bf6a-0532daa70e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6b354389-731d-487b-b841-ca9149ecef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:26:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Flow 'volume_create_scheduler' (ee319785-f753-405f-a726-60dc78b560d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:26:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=8,cinder:SELECT=26 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Flow 'volume_create_scheduler' (a1a63746-741f-4d87-9cf2-992d0287b618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (06c23191-c71c-4153-b47b-8be8941cdfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (06c23191-c71c-4153-b47b-8be8941cdfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2e8580be-c7f2-4d3a-9007-d192a5b029b3),volume_id=2e8580be-c7f2-4d3a-9007-d192a5b029b3,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ef2fbc19-e6a3-45ea-a5e9-dc6a0eab2c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:26:45 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Error scheduling 2e8580be-c7f2-4d3a-9007-d192a5b029b3 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:02.855490 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2e8580be-c7f2-4d3a-9007-d192a5b029b3) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 48, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 74, 'calculated_free_capacity': 45.0, 'virtual_free_capacity': 45.0, 'free_percent': 37.82, 'provisioned_ratio': 0.62, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/45.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:02.855490] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Weigher CapacityWeigher returned, weigher value is {max: 45.0, min: 45.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 47, total_capacity_gb: 119, allocated_capacity_gb: 75, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 75, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:45.240995 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ef2fbc19-e6a3-45ea-a5e9-dc6a0eab2c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:26:45 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Flow 'volume_create_scheduler' (a1a63746-741f-4d87-9cf2-992d0287b618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (1db255dd-ebd8-4d73-88cd-2df8fc477e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0138f0c8-1700-4836-b686-06c334db72fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0138f0c8-1700-4836-b686-06c334db72fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(53029faa-77b2-467d-8a64-eb5ef129e41c),volume_id=53029faa-77b2-467d-8a64-eb5ef129e41c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4febcab4-a5df-49f0-a4e4-2a1933e6ca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:26:57 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Error scheduling 53029faa-77b2-467d-8a64-eb5ef129e41c from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:45.240995 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (53029faa-77b2-467d-8a64-eb5ef129e41c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 48, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 74, 'calculated_free_capacity': 45.0, 'virtual_free_capacity': 45.0, 'free_percent': 37.82, 'provisioned_ratio': 0.62, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/45.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:45.240995] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Weigher CapacityWeigher returned, weigher value is {max: 45.0, min: 45.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 47, total_capacity_gb: 119, allocated_capacity_gb: 75, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 75, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:57.650535 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4febcab4-a5df-49f0-a4e4-2a1933e6ca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:26:57 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (1db255dd-ebd8-4d73-88cd-2df8fc477e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Flow 'volume_create_scheduler' (e7ff17f8-029c-4773-b9eb-ed9ef436889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d7ba3151-fefd-4969-8147-d4c70486e2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d7ba3151-fefd-4969-8147-d4c70486e2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(35a67ca3-0f17-4a6c-a359-9173ce5f1aca),volume_id=35a67ca3-0f17-4a6c-a359-9173ce5f1aca,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7b9675a4-c3a8-4770-aa4c-40d6a3590d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:27:00 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Error scheduling 35a67ca3-0f17-4a6c-a359-9173ce5f1aca from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:57.650535 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (35a67ca3-0f17-4a6c-a359-9173ce5f1aca) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 48, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 74, 'calculated_free_capacity': 45.0, 'virtual_free_capacity': 45.0, 'free_percent': 37.82, 'provisioned_ratio': 0.62, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/45.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 48, total_capacity_gb: 119, allocated_capacity_gb: 74, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 74, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:26:57.650535] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Weigher CapacityWeigher returned, weigher value is {max: 45.0, min: 45.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 47, total_capacity_gb: 119, allocated_capacity_gb: 75, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 75, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:27:00.687883 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7b9675a4-c3a8-4770-aa4c-40d6a3590d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:27:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Flow 'volume_create_scheduler' (e7ff17f8-029c-4773-b9eb-ed9ef436889c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:27:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=36,cinder:UPDATE=10 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:27:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (40bea6b5-29a6-4d91-84fb-1986dbcd54d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1517bbb9-3b8a-4317-ac75-9e1589238db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1517bbb9-3b8a-4317-ac75-9e1589238db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8),volume_id=8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7e306c99-3206-41a5-8809-dbced3bf9e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 47, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 75, 'calculated_free_capacity': 44.0, 'virtual_free_capacity': 44.0, 'free_percent': 36.97, 'provisioned_ratio': 0.63, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/44.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 47, total_capacity_gb: 119, allocated_capacity_gb: 75, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 75, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:27:00.687883] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Weigher CapacityWeigher returned, weigher value is {max: 44.0, min: 44.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 46, total_capacity_gb: 119, allocated_capacity_gb: 76, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 76, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:27:59.062437 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7e306c99-3206-41a5-8809-dbced3bf9e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:27:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (40bea6b5-29a6-4d91-84fb-1986dbcd54d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Flow 'volume_create_scheduler' (53127245-12d5-4cf8-8481-e7bb4fb283ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (835f95a0-bc8e-401a-9b8c-c69dff5de292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (835f95a0-bc8e-401a-9b8c-c69dff5de292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2159f1f1-2564-4d84-8110-c1f7d843edb1),volume_id=2159f1f1-2564-4d84-8110-c1f7d843edb1,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6084d3a2-1849-433a-8fc1-4999c4674553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2159f1f1-2564-4d84-8110-c1f7d843edb1) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 46, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 76, 'calculated_free_capacity': 43.0, 'virtual_free_capacity': 43.0, 'free_percent': 36.13, 'provisioned_ratio': 0.64, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/43.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 46, total_capacity_gb: 119, allocated_capacity_gb: 76, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 76, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:27:59.062437] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Weigher CapacityWeigher returned, weigher value is {max: 43.0, min: 43.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:28:03.052173 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6084d3a2-1849-433a-8fc1-4999c4674553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:28:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Flow 'volume_create_scheduler' (53127245-12d5-4cf8-8481-e7bb4fb283ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (17ae1de6-c36e-4388-a233-81856bd1620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c8515c80-c260-4920-b5ca-890627a71982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c8515c80-c260-4920-b5ca-890627a71982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f6c0e341-6f00-4e32-bd07-31f954c1ad8a),volume_id=f6c0e341-6f00-4e32-bd07-31f954c1ad8a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a1bd2b30-7561-421e-8c50-52eb24e731d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f6c0e341-6f00-4e32-bd07-31f954c1ad8a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 45, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 77, 'calculated_free_capacity': 42.0, 'virtual_free_capacity': 42.0, 'free_percent': 35.29, 'provisioned_ratio': 0.65, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/42.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:28:03.052173] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Weigher CapacityWeigher returned, weigher value is {max: 42.0, min: 42.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 44, total_capacity_gb: 119, allocated_capacity_gb: 78, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 78, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:28:09.881612 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a1bd2b30-7561-421e-8c50-52eb24e731d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:28:09 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (17ae1de6-c36e-4388-a233-81856bd1620e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:28:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=9,cinder:SELECT=42 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Flow 'volume_create_scheduler' (091bd158-b2ae-4ca0-a01c-e8e261d5df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9e5802f0-beab-4acb-8e7e-c8e723e941c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (9e5802f0-beab-4acb-8e7e-c8e723e941c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(94610127-c8b8-4df4-9e39-a1f41b5a9b98),volume_id=94610127-c8b8-4df4-9e39-a1f41b5a9b98,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (79ab8d0d-4b41-473f-91ea-9ec756971dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:28:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Error scheduling 94610127-c8b8-4df4-9e39-a1f41b5a9b98 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:28:21 user cinder-scheduler[84081]: INFO cinder.message.api [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Creating message record for request_id = req-d3245848-3d3a-4130-8413-3f811df2f47d Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:28:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 94610127-c8b8-4df4-9e39-a1f41b5a9b98: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 94610127-c8b8-4df4-9e39-a1f41b5a9b98 Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Setting Volume 94610127-c8b8-4df4-9e39-a1f41b5a9b98 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 94610127-c8b8-4df4-9e39-a1f41b5a9b98 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (3d2a5125-2bb6-4586-98e6-4f6fe9b9300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (97c5ddcc-f44d-43bc-836c-b6a36ab52a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (97c5ddcc-f44d-43bc-836c-b6a36ab52a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=fe50cd00-dcd4-4b21-a4e9-6f226f8c6ac1,image_id=None,operation=,resource_backend='user@joviandss-2',snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(02aba338-fa31-4e46-8fcf-7f86191e44d1),volume_id=02aba338-fa31-4e46-8fcf-7f86191e44d1,volume_properties=VolumeProperties,volume_type=VolumeType(400bec8d-bd01-4057-8fb8-49a786cd39f1))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d3b95793-91f0-4dbb-a8a4-f2706e8023d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:28:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Error scheduling 02aba338-fa31-4e46-8fcf-7f86191e44d1 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:28:21 user cinder-scheduler[84081]: INFO cinder.message.api [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Creating message record for request_id = req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (79ab8d0d-4b41-473f-91ea-9ec756971dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] Flow 'volume_create_scheduler' (091bd158-b2ae-4ca0-a01c-e8e261d5df0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-d3245848-3d3a-4130-8413-3f811df2f47d tempest-AbsoluteLimitsTests-986281014 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:28:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 02aba338-fa31-4e46-8fcf-7f86191e44d1: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 02aba338-fa31-4e46-8fcf-7f86191e44d1 Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Setting Volume 02aba338-fa31-4e46-8fcf-7f86191e44d1 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 02aba338-fa31-4e46-8fcf-7f86191e44d1 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d3b95793-91f0-4dbb-a8a4-f2706e8023d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:28:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-476320d2-f85f-4dd0-bac3-38a67c9e0e47 tempest-GroupsTest-789764105 None] Flow 'volume_create_scheduler' (3d2a5125-2bb6-4586-98e6-4f6fe9b9300e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:28:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=8,cinder:SELECT=22,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:29:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Flow 'volume_create_scheduler' (fe7d98b5-f284-42dd-ae30-1ebd38b35298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:29:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8e5ff612-a9e0-43ad-97ea-28f7856b341e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:29:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8e5ff612-a9e0-43ad-97ea-28f7856b341e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2e8580be-c7f2-4d3a-9007-d192a5b029b3),volume_id=2e8580be-c7f2-4d3a-9007-d192a5b029b3,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:29:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0294d0ce-471d-4f27-a9ae-29348e2b8088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:29:05 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Error scheduling 2e8580be-c7f2-4d3a-9007-d192a5b029b3 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:29:05 user cinder-scheduler[84081]: INFO cinder.message.api [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Creating message record for request_id = req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 Apr 17 16:29:05 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:29:05 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2e8580be-c7f2-4d3a-9007-d192a5b029b3: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2e8580be-c7f2-4d3a-9007-d192a5b029b3 Apr 17 16:29:05 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Setting Volume 2e8580be-c7f2-4d3a-9007-d192a5b029b3 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2e8580be-c7f2-4d3a-9007-d192a5b029b3 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:29:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0294d0ce-471d-4f27-a9ae-29348e2b8088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:29:05 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f30cda1b-0a2e-45d5-b75e-6fcb7871e267 tempest-VolumesNegativeTest-1370732729 None] Flow 'volume_create_scheduler' (fe7d98b5-f284-42dd-ae30-1ebd38b35298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (976c8733-4c39-435f-9e82-dbf90c8cbe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (08a1feeb-58a6-48d6-859e-b038951e1022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (08a1feeb-58a6-48d6-859e-b038951e1022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(53029faa-77b2-467d-8a64-eb5ef129e41c),volume_id=53029faa-77b2-467d-8a64-eb5ef129e41c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7e7a10ed-6fbe-4d9d-ae56-82ca8f20568c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:29:14 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Error scheduling 53029faa-77b2-467d-8a64-eb5ef129e41c from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:28:09.881612 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (53029faa-77b2-467d-8a64-eb5ef129e41c) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 45, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 77, 'calculated_free_capacity': 42.0, 'virtual_free_capacity': 42.0, 'free_percent': 35.29, 'provisioned_ratio': 0.65, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/42.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:28:09.881612] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Weigher CapacityWeigher returned, weigher value is {max: 42.0, min: 42.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 44, total_capacity_gb: 119, allocated_capacity_gb: 78, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 78, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:29:14.650988 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7e7a10ed-6fbe-4d9d-ae56-82ca8f20568c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:29:14 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (976c8733-4c39-435f-9e82-dbf90c8cbe1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Flow 'volume_create_scheduler' (cee735e8-c33d-4531-a071-e71e961aeda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (596ce9f2-e8e3-441a-bc6b-a75fb0edbf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (596ce9f2-e8e3-441a-bc6b-a75fb0edbf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(35a67ca3-0f17-4a6c-a359-9173ce5f1aca),volume_id=35a67ca3-0f17-4a6c-a359-9173ce5f1aca,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7582bed5-fb6d-4985-86d2-a22aa49b37fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:29:17 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Error scheduling 35a67ca3-0f17-4a6c-a359-9173ce5f1aca from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:29:14.650988 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (35a67ca3-0f17-4a6c-a359-9173ce5f1aca) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 45, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 77, 'calculated_free_capacity': 42.0, 'virtual_free_capacity': 42.0, 'free_percent': 35.29, 'provisioned_ratio': 0.65, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/42.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:29:14.650988] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Weigher CapacityWeigher returned, weigher value is {max: 42.0, min: 42.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 44, total_capacity_gb: 119, allocated_capacity_gb: 78, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 78, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:29:17.722029 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7582bed5-fb6d-4985-86d2-a22aa49b37fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:29:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Flow 'volume_create_scheduler' (cee735e8-c33d-4531-a071-e71e961aeda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:29:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=34,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:30:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (9fe4be75-9b05-4f94-bfaf-33cc9f7eb8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b2314abe-0bed-4ec8-8299-61b417820c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b2314abe-0bed-4ec8-8299-61b417820c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8),volume_id=8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (84c0d812-81a3-4538-b64d-f01e797b7d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:30:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Error scheduling 8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:29:17.722029 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 45, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 77, 'calculated_free_capacity': 42.0, 'virtual_free_capacity': 42.0, 'free_percent': 35.29, 'provisioned_ratio': 0.65, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/42.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:29:17.722029] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Weigher CapacityWeigher returned, weigher value is {max: 42.0, min: 42.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 44, total_capacity_gb: 119, allocated_capacity_gb: 78, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 78, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:30:21.850948 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Flow 'volume_create_scheduler' (90ab1133-9dfd-4b03-87a6-c180d6771141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c768e155-2ff7-4e14-9f5e-e72dd92711f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c768e155-2ff7-4e14-9f5e-e72dd92711f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2159f1f1-2564-4d84-8110-c1f7d843edb1),volume_id=2159f1f1-2564-4d84-8110-c1f7d843edb1,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b436e851-8918-41b2-859b-427302d94979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:30:21 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Error scheduling 2159f1f1-2564-4d84-8110-c1f7d843edb1 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:30:21.850948 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2159f1f1-2564-4d84-8110-c1f7d843edb1) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 45, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 77, 'calculated_free_capacity': 42.0, 'virtual_free_capacity': 42.0, 'free_percent': 35.29, 'provisioned_ratio': 0.65, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/42.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:30:21.850948] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Weigher CapacityWeigher returned, weigher value is {max: 42.0, min: 42.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 44, total_capacity_gb: 119, allocated_capacity_gb: 78, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 78, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:30:21.896064 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (84c0d812-81a3-4538-b64d-f01e797b7d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (9fe4be75-9b05-4f94-bfaf-33cc9f7eb8fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b436e851-8918-41b2-859b-427302d94979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:30:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Flow 'volume_create_scheduler' (90ab1133-9dfd-4b03-87a6-c180d6771141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (084b38eb-1446-475e-a675-0e961c813eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (209f4e18-17bd-43c2-905a-c3c718ab7a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (209f4e18-17bd-43c2-905a-c3c718ab7a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f6c0e341-6f00-4e32-bd07-31f954c1ad8a),volume_id=f6c0e341-6f00-4e32-bd07-31f954c1ad8a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (57b1ddea-5c55-4b1c-87c0-70a63f73fd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:30:27 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Error scheduling f6c0e341-6f00-4e32-bd07-31f954c1ad8a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:30:21.896064 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f6c0e341-6f00-4e32-bd07-31f954c1ad8a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 45, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 77, 'calculated_free_capacity': 42.0, 'virtual_free_capacity': 42.0, 'free_percent': 35.29, 'provisioned_ratio': 0.65, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/42.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 45, total_capacity_gb: 119, allocated_capacity_gb: 77, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 77, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:30:21.896064] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Weigher CapacityWeigher returned, weigher value is {max: 42.0, min: 42.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 44, total_capacity_gb: 119, allocated_capacity_gb: 78, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 78, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:30:27.898641 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (57b1ddea-5c55-4b1c-87c0-70a63f73fd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:30:27 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (084b38eb-1446-475e-a675-0e961c813eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:30:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=35,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Flow 'volume_create_scheduler' (69155ac6-5715-4032-bd88-975422e0d635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f18dfd70-8d60-47c8-963f-47269a2251c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f18dfd70-8d60-47c8-963f-47269a2251c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf85ce23-1db3-4881-bd7a-b20b520718b8),volume_id=bf85ce23-1db3-4881-bd7a-b20b520718b8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a533c901-9363-497d-be44-1fb31ee02120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bf85ce23-1db3-4881-bd7a-b20b520718b8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 44, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 78, 'calculated_free_capacity': 41.0, 'virtual_free_capacity': 41.0, 'free_percent': 34.45, 'provisioned_ratio': 0.66, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/41.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 44, total_capacity_gb: 119, allocated_capacity_gb: 78, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 78, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:30:27.898641] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Weigher CapacityWeigher returned, weigher value is {max: 41.0, min: 41.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 43, total_capacity_gb: 119, allocated_capacity_gb: 79, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 79, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:31:17.636024 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a533c901-9363-497d-be44-1fb31ee02120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:17 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Flow 'volume_create_scheduler' (69155ac6-5715-4032-bd88-975422e0d635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Flow 'volume_create_scheduler' (dcdcce97-69bc-4e4a-a27d-c9c4bfa8df2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d4ca5595-5b4a-4c62-836d-7b0e1833acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d4ca5595-5b4a-4c62-836d-7b0e1833acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7384f51d-c3a2-4eea-a968-ec043946989f),volume_id=7384f51d-c3a2-4eea-a968-ec043946989f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0cafe040-ea3e-457a-a368-6129021d54db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7384f51d-c3a2-4eea-a968-ec043946989f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 43, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 79, 'calculated_free_capacity': 40.0, 'virtual_free_capacity': 40.0, 'free_percent': 33.61, 'provisioned_ratio': 0.66, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/40.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 43, total_capacity_gb: 119, allocated_capacity_gb: 79, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 79, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:31:17.636024] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Weigher CapacityWeigher returned, weigher value is {max: 40.0, min: 40.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:31:21.548019 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0cafe040-ea3e-457a-a368-6129021d54db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:21 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Flow 'volume_create_scheduler' (dcdcce97-69bc-4e4a-a27d-c9c4bfa8df2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (069f713a-c419-4666-835f-a5da4489e211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0e67dd1f-447c-4d8a-a2ff-974b91743f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0e67dd1f-447c-4d8a-a2ff-974b91743f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(480a94a0-d1c9-46c0-bf9f-c42f907b4b82),volume_id=480a94a0-d1c9-46c0-bf9f-c42f907b4b82,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (65f77feb-9368-45c2-a4fe-ba6948396417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (480a94a0-d1c9-46c0-bf9f-c42f907b4b82) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 42, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 80, 'calculated_free_capacity': 39.0, 'virtual_free_capacity': 39.0, 'free_percent': 32.77, 'provisioned_ratio': 0.67, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/39.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:31:21.548019] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Weigher CapacityWeigher returned, weigher value is {max: 39.0, min: 39.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:31:26.021831 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (65f77feb-9368-45c2-a4fe-ba6948396417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:26 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (069f713a-c419-4666-835f-a5da4489e211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (3a7ee787-aec0-4401-9b5e-c40803f86aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5cc3ab51-a3ec-42a0-b47d-da016c72b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5cc3ab51-a3ec-42a0-b47d-da016c72b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(53029faa-77b2-467d-8a64-eb5ef129e41c),volume_id=53029faa-77b2-467d-8a64-eb5ef129e41c,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8246d750-2ce0-4cf6-9d43-d235de0fd264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:33 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Error scheduling 53029faa-77b2-467d-8a64-eb5ef129e41c from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:31:33 user cinder-scheduler[84081]: INFO cinder.message.api [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Creating message record for request_id = req-8d765f93-bce0-4815-ac07-22b8b3bd2556 Apr 17 16:31:33 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:31:33 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 53029faa-77b2-467d-8a64-eb5ef129e41c: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 53029faa-77b2-467d-8a64-eb5ef129e41c Apr 17 16:31:33 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Setting Volume 53029faa-77b2-467d-8a64-eb5ef129e41c to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 53029faa-77b2-467d-8a64-eb5ef129e41c {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:31:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8246d750-2ce0-4cf6-9d43-d235de0fd264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:33 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-8d765f93-bce0-4815-ac07-22b8b3bd2556 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (3a7ee787-aec0-4401-9b5e-c40803f86aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Flow 'volume_create_scheduler' (5bdd70d3-33f6-4efe-a0c2-68538cf4b7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d48d8e82-7df8-4317-acd2-683863eda5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d48d8e82-7df8-4317-acd2-683863eda5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(35a67ca3-0f17-4a6c-a359-9173ce5f1aca),volume_id=35a67ca3-0f17-4a6c-a359-9173ce5f1aca,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8c4a8b27-28aa-488f-9b44-3bba4eacafe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:31:36 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Error scheduling 35a67ca3-0f17-4a6c-a359-9173ce5f1aca from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:31:36 user cinder-scheduler[84081]: INFO cinder.message.api [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Creating message record for request_id = req-61f60e22-802a-4068-b929-14f669a47260 Apr 17 16:31:36 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:31:36 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 35a67ca3-0f17-4a6c-a359-9173ce5f1aca: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 35a67ca3-0f17-4a6c-a359-9173ce5f1aca Apr 17 16:31:36 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Setting Volume 35a67ca3-0f17-4a6c-a359-9173ce5f1aca to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 35a67ca3-0f17-4a6c-a359-9173ce5f1aca {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:31:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (8c4a8b27-28aa-488f-9b44-3bba4eacafe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:31:36 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-61f60e22-802a-4068-b929-14f669a47260 tempest-SnapshotsActionsTest-1211835385 None] Flow 'volume_create_scheduler' (5bdd70d3-33f6-4efe-a0c2-68538cf4b7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:31:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=54,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:32:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (d28d1f2c-b484-427c-ac88-3dcdb5f21bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bbf0e0a3-a303-433a-8678-e4c8e9eb6842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (bbf0e0a3-a303-433a-8678-e4c8e9eb6842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8),volume_id=8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e6684e5f-23cc-4aac-a240-7a76a9ec6544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:32:41 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Error scheduling 8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:31:26.021831 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 42, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 80, 'calculated_free_capacity': 39.0, 'virtual_free_capacity': 39.0, 'free_percent': 32.77, 'provisioned_ratio': 0.67, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/39.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:31:26.021831] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Weigher CapacityWeigher returned, weigher value is {max: 39.0, min: 39.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:32:41.517207 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Flow 'volume_create_scheduler' (ac72686d-faae-475d-b30c-976f01ceca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f44bc4fd-2e76-4b30-b9e1-c550ad38b8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (f44bc4fd-2e76-4b30-b9e1-c550ad38b8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2159f1f1-2564-4d84-8110-c1f7d843edb1),volume_id=2159f1f1-2564-4d84-8110-c1f7d843edb1,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eeea556e-7e91-4f8e-9b8d-278cf2ff3809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:32:41 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Error scheduling 2159f1f1-2564-4d84-8110-c1f7d843edb1 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:32:41.517207 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (2159f1f1-2564-4d84-8110-c1f7d843edb1) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 42, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 80, 'calculated_free_capacity': 39.0, 'virtual_free_capacity': 39.0, 'free_percent': 32.77, 'provisioned_ratio': 0.67, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/39.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:32:41.517207] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Weigher CapacityWeigher returned, weigher value is {max: 39.0, min: 39.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:32:41.566543 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (e6684e5f-23cc-4aac-a240-7a76a9ec6544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (d28d1f2c-b484-427c-ac88-3dcdb5f21bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eeea556e-7e91-4f8e-9b8d-278cf2ff3809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:32:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Flow 'volume_create_scheduler' (ac72686d-faae-475d-b30c-976f01ceca33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (41e470aa-03ff-4eba-ab22-94e1919e549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1bf030a8-1464-4f41-afc4-6c0756c401ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (1bf030a8-1464-4f41-afc4-6c0756c401ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f6c0e341-6f00-4e32-bd07-31f954c1ad8a),volume_id=f6c0e341-6f00-4e32-bd07-31f954c1ad8a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6cf3565b-34a7-4258-afb7-b25cddf793c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:32:47 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Error scheduling f6c0e341-6f00-4e32-bd07-31f954c1ad8a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:32:41.566543 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f6c0e341-6f00-4e32-bd07-31f954c1ad8a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 42, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 80, 'calculated_free_capacity': 39.0, 'virtual_free_capacity': 39.0, 'free_percent': 32.77, 'provisioned_ratio': 0.67, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/39.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:32:41.566543] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Weigher CapacityWeigher returned, weigher value is {max: 39.0, min: 39.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:32:47.591443 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6cf3565b-34a7-4258-afb7-b25cddf793c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:32:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (41e470aa-03ff-4eba-ab22-94e1919e549c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:33:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=35,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Flow 'volume_create_scheduler' (20045731-0494-40e6-bd6c-28efcc5b0f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7268655a-de31-4526-8642-b7d8a2ac267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (7268655a-de31-4526-8642-b7d8a2ac267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf85ce23-1db3-4881-bd7a-b20b520718b8),volume_id=bf85ce23-1db3-4881-bd7a-b20b520718b8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (36cb0cf8-d085-4363-a515-06601e72a91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:33:31 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Error scheduling bf85ce23-1db3-4881-bd7a-b20b520718b8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:32:47.591443 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bf85ce23-1db3-4881-bd7a-b20b520718b8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 42, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 80, 'calculated_free_capacity': 39.0, 'virtual_free_capacity': 39.0, 'free_percent': 32.77, 'provisioned_ratio': 0.67, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/39.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:32:47.591443] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Weigher CapacityWeigher returned, weigher value is {max: 39.0, min: 39.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:33:31.774261 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (36cb0cf8-d085-4363-a515-06601e72a91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:33:31 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Flow 'volume_create_scheduler' (20045731-0494-40e6-bd6c-28efcc5b0f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:33:40 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=6,cinder:SELECT=18 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:33:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Flow 'volume_create_scheduler' (d2c56fdc-ac12-4a5b-bf5d-5016040eb4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:33:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c8d40778-d968-40da-8702-4d2d595aa801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:33:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c8d40778-d968-40da-8702-4d2d595aa801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7384f51d-c3a2-4eea-a968-ec043946989f),volume_id=7384f51d-c3a2-4eea-a968-ec043946989f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:33:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6ba330f4-0466-42c0-b6d1-ef9048fde0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:33:40 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Error scheduling 7384f51d-c3a2-4eea-a968-ec043946989f from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:33:40 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:33:31.774261 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7384f51d-c3a2-4eea-a968-ec043946989f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 42, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 80, 'calculated_free_capacity': 39.0, 'virtual_free_capacity': 39.0, 'free_percent': 32.77, 'provisioned_ratio': 0.67, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/39.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:33:31.774261] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Weigher CapacityWeigher returned, weigher value is {max: 39.0, min: 39.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:33:41.016719 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (6ba330f4-0466-42c0-b6d1-ef9048fde0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:33:41 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Flow 'volume_create_scheduler' (d2c56fdc-ac12-4a5b-bf5d-5016040eb4be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (15f8f309-c18d-41bb-8b49-b1274f7a0452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5935baac-b972-4fc4-b0ca-705f6d3c9ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (5935baac-b972-4fc4-b0ca-705f6d3c9ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(480a94a0-d1c9-46c0-bf9f-c42f907b4b82),volume_id=480a94a0-d1c9-46c0-bf9f-c42f907b4b82,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bf5b016f-b9a3-47a8-bbda-eb748319873f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:33:44 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Error scheduling 480a94a0-d1c9-46c0-bf9f-c42f907b4b82 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:33:41.016719 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (480a94a0-d1c9-46c0-bf9f-c42f907b4b82) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 42, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 80, 'calculated_free_capacity': 39.0, 'virtual_free_capacity': 39.0, 'free_percent': 32.77, 'provisioned_ratio': 0.67, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/39.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 42, total_capacity_gb: 119, allocated_capacity_gb: 80, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 80, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:33:41.016719] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Weigher CapacityWeigher returned, weigher value is {max: 39.0, min: 39.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:33:44.076817 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bf5b016f-b9a3-47a8-bbda-eb748319873f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:33:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (15f8f309-c18d-41bb-8b49-b1274f7a0452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:34:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=25,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:34:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Flow 'volume_create_scheduler' (79c5f89b-ca3f-4e51-82a2-e371c28dbec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8156e087-dd61-499c-941c-834dfae6bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8156e087-dd61-499c-941c-834dfae6bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e1bb78ac-29e3-46df-9bbe-3b152e39b69a),volume_id=e1bb78ac-29e3-46df-9bbe-3b152e39b69a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (495f32aa-ff90-4eb9-a0e7-e2f752924ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (e1bb78ac-29e3-46df-9bbe-3b152e39b69a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 41, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 81, 'calculated_free_capacity': 38.0, 'virtual_free_capacity': 38.0, 'free_percent': 31.93, 'provisioned_ratio': 0.68, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/38.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:33:44.076817] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Weigher CapacityWeigher returned, weigher value is {max: 38.0, min: 38.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 40, total_capacity_gb: 119, allocated_capacity_gb: 82, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 82, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:34:47.331378 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (495f32aa-ff90-4eb9-a0e7-e2f752924ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:34:47 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Flow 'volume_create_scheduler' (79c5f89b-ca3f-4e51-82a2-e371c28dbec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Flow 'volume_create_scheduler' (9fceecc9-c46e-410a-8742-96645e3b6775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0ac2a9ac-5329-4da6-be29-9415281cd261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (0ac2a9ac-5329-4da6-be29-9415281cd261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(2159f1f1-2564-4d84-8110-c1f7d843edb1),volume_id=2159f1f1-2564-4d84-8110-c1f7d843edb1,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (251b2261-2a3c-4a49-9fd4-94e74306b422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:35:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Error scheduling 2159f1f1-2564-4d84-8110-c1f7d843edb1 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:35:01 user cinder-scheduler[84081]: INFO cinder.message.api [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Creating message record for request_id = req-34802d26-273b-4fa3-a0d4-af12da0d916e Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:35:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2159f1f1-2564-4d84-8110-c1f7d843edb1: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2159f1f1-2564-4d84-8110-c1f7d843edb1 Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Setting Volume 2159f1f1-2564-4d84-8110-c1f7d843edb1 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 2159f1f1-2564-4d84-8110-c1f7d843edb1 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (251b2261-2a3c-4a49-9fd4-94e74306b422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-34802d26-273b-4fa3-a0d4-af12da0d916e tempest-VolumesSnapshotListTestJSON-1099444740 None] Flow 'volume_create_scheduler' (9fceecc9-c46e-410a-8742-96645e3b6775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (eaef6c00-1659-406a-8e9f-57d61e046bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c6640ae9-0880-496d-b3a8-5747900484f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (c6640ae9-0880-496d-b3a8-5747900484f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8),volume_id=8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5df1fc57-1b49-42ac-9a9e-5bbd05c2b0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:35:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Error scheduling 8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:35:01 user cinder-scheduler[84081]: INFO cinder.message.api [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Creating message record for request_id = req-ccbb52f2-042b-41e0-9837-623e8a9a2738 Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:35:01 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8 Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Setting Volume 8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 8b7f1136-3d20-4cf8-a521-6db1d3a0c8a8 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (5df1fc57-1b49-42ac-9a9e-5bbd05c2b0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:35:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-ccbb52f2-042b-41e0-9837-623e8a9a2738 tempest-VolumesDeleteCascade-645320261 None] Flow 'volume_create_scheduler' (eaef6c00-1659-406a-8e9f-57d61e046bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:35:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (b87a5246-7068-4007-8ff3-125c5c0855f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:35:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (909a5729-3d0f-4d7a-a67f-92b92ae8eb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:35:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (909a5729-3d0f-4d7a-a67f-92b92ae8eb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f6c0e341-6f00-4e32-bd07-31f954c1ad8a),volume_id=f6c0e341-6f00-4e32-bd07-31f954c1ad8a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:35:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a0dd29a2-5938-4c38-b048-38cfc9d3be87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:35:06 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Error scheduling f6c0e341-6f00-4e32-bd07-31f954c1ad8a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:35:06 user cinder-scheduler[84081]: INFO cinder.message.api [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Creating message record for request_id = req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d Apr 17 16:35:06 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:35:06 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource f6c0e341-6f00-4e32-bd07-31f954c1ad8a: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource f6c0e341-6f00-4e32-bd07-31f954c1ad8a Apr 17 16:35:06 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Setting Volume f6c0e341-6f00-4e32-bd07-31f954c1ad8a to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource f6c0e341-6f00-4e32-bd07-31f954c1ad8a {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:35:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (a0dd29a2-5938-4c38-b048-38cfc9d3be87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:35:06 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-4c23c8b0-66e0-4b59-bc55-c45427bf9e5d tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (b87a5246-7068-4007-8ff3-125c5c0855f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:35:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=11,cinder:SELECT=38,cinder:INSERT=3,cinder:DELETE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:35:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Flow 'volume_create_scheduler' (6369af23-07c6-4365-b805-47905b28d12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (75b7982f-7246-4ec2-a513-70caed82a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (75b7982f-7246-4ec2-a513-70caed82a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf85ce23-1db3-4881-bd7a-b20b520718b8),volume_id=bf85ce23-1db3-4881-bd7a-b20b520718b8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (db5571f1-1268-476a-83f8-9e232a9a003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:35:50 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Error scheduling bf85ce23-1db3-4881-bd7a-b20b520718b8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:34:47.331378 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (bf85ce23-1db3-4881-bd7a-b20b520718b8) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 41, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 81, 'calculated_free_capacity': 38.0, 'virtual_free_capacity': 38.0, 'free_percent': 31.93, 'provisioned_ratio': 0.68, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/38.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:34:47.331378] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Weigher CapacityWeigher returned, weigher value is {max: 38.0, min: 38.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 40, total_capacity_gb: 119, allocated_capacity_gb: 82, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 82, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:35:50.883291 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (db5571f1-1268-476a-83f8-9e232a9a003c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:35:50 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Flow 'volume_create_scheduler' (6369af23-07c6-4365-b805-47905b28d12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Flow 'volume_create_scheduler' (1cff5348-90f8-41cc-ae65-6d3b9553d11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d0e3e306-58b6-4bd7-b4f3-c530d332f684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (d0e3e306-58b6-4bd7-b4f3-c530d332f684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7384f51d-c3a2-4eea-a968-ec043946989f),volume_id=7384f51d-c3a2-4eea-a968-ec043946989f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aca07e9a-1f6c-46c7-aa2f-1918e7e9e3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:36:00 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Error scheduling 7384f51d-c3a2-4eea-a968-ec043946989f from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:35:50.883291 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (7384f51d-c3a2-4eea-a968-ec043946989f) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 41, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 81, 'calculated_free_capacity': 38.0, 'virtual_free_capacity': 38.0, 'free_percent': 31.93, 'provisioned_ratio': 0.68, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/38.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:35:50.883291] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Weigher CapacityWeigher returned, weigher value is {max: 38.0, min: 38.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 40, total_capacity_gb: 119, allocated_capacity_gb: 82, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 82, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:36:00.090851 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (aca07e9a-1f6c-46c7-aa2f-1918e7e9e3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:36:00 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Flow 'volume_create_scheduler' (1cff5348-90f8-41cc-ae65-6d3b9553d11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (b3511e62-edbc-40de-baf0-7cdbc7c8d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dfc9291d-1657-47a1-8847-b0765385345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (dfc9291d-1657-47a1-8847-b0765385345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(480a94a0-d1c9-46c0-bf9f-c42f907b4b82),volume_id=480a94a0-d1c9-46c0-bf9f-c42f907b4b82,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (da19ee10-ef11-4515-bdeb-4c3cbb1e9cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:36:03 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Error scheduling 480a94a0-d1c9-46c0-bf9f-c42f907b4b82 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:36:00.090851 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (480a94a0-d1c9-46c0-bf9f-c42f907b4b82) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 41, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 81, 'calculated_free_capacity': 38.0, 'virtual_free_capacity': 38.0, 'free_percent': 31.93, 'provisioned_ratio': 0.68, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/38.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:36:00.090851] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Weigher CapacityWeigher returned, weigher value is {max: 38.0, min: 38.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 40, total_capacity_gb: 119, allocated_capacity_gb: 82, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 82, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:36:03.169719 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (da19ee10-ef11-4515-bdeb-4c3cbb1e9cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:36:03 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (b3511e62-edbc-40de-baf0-7cdbc7c8d015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:36:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=33,cinder:UPDATE=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:36:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Flow 'volume_create_scheduler' (64c30258-f006-4ca3-81c9-a193afc5356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6484057f-7db3-40ce-9d43-02244aec6e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (6484057f-7db3-40ce-9d43-02244aec6e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e1bb78ac-29e3-46df-9bbe-3b152e39b69a),volume_id=e1bb78ac-29e3-46df-9bbe-3b152e39b69a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ee9a12e2-4831-4bbd-a58e-1a605828776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:37:07 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Error scheduling e1bb78ac-29e3-46df-9bbe-3b152e39b69a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:36:03.169719 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (e1bb78ac-29e3-46df-9bbe-3b152e39b69a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 41, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 81, 'calculated_free_capacity': 38.0, 'virtual_free_capacity': 38.0, 'free_percent': 31.93, 'provisioned_ratio': 0.68, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/38.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 41, total_capacity_gb: 119, allocated_capacity_gb: 81, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 81, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:36:03.169719] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Weigher CapacityWeigher returned, weigher value is {max: 38.0, min: 38.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 40, total_capacity_gb: 119, allocated_capacity_gb: 82, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 82, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:37:07.144753 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ee9a12e2-4831-4bbd-a58e-1a605828776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:37:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Flow 'volume_create_scheduler' (64c30258-f006-4ca3-81c9-a193afc5356b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:37:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:37:44 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Flow 'volume_create_scheduler' (12115d03-2535-4cab-8bf6-336bea87213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8927d0b3-0691-44ab-a4c2-31832b20869a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (8927d0b3-0691-44ab-a4c2-31832b20869a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f920a5f7-106a-4092-b193-c3d340118d77),volume_id=f920a5f7-106a-4092-b193-c3d340118d77,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b2f17f52-d5bd-4874-a00a-37a4759809c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f920a5f7-106a-4092-b193-c3d340118d77) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 40, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 82, 'calculated_free_capacity': 37.0, 'virtual_free_capacity': 37.0, 'free_percent': 31.09, 'provisioned_ratio': 0.69, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/37.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 40, total_capacity_gb: 119, allocated_capacity_gb: 82, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 82, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:37:07.144753] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Weigher CapacityWeigher returned, weigher value is {max: 37.0, min: 37.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:38:07.616078 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b2f17f52-d5bd-4874-a00a-37a4759809c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:38:07 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Flow 'volume_create_scheduler' (12115d03-2535-4cab-8bf6-336bea87213d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:38:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Flow 'volume_create_scheduler' (e7455ddb-e5d5-4ecd-b26a-5fb285ce2ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:38:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (86e27291-e615-406c-92a8-455f0e066d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:38:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (86e27291-e615-406c-92a8-455f0e066d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(bf85ce23-1db3-4881-bd7a-b20b520718b8),volume_id=bf85ce23-1db3-4881-bd7a-b20b520718b8,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:38:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d6968a0a-f202-43f9-ab09-5880aadb825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:38:10 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Error scheduling bf85ce23-1db3-4881-bd7a-b20b520718b8 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:38:10 user cinder-scheduler[84081]: INFO cinder.message.api [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Creating message record for request_id = req-208fb94c-86af-4459-a279-1c8be9781cb3 Apr 17 16:38:10 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:38:10 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource bf85ce23-1db3-4881-bd7a-b20b520718b8: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource bf85ce23-1db3-4881-bd7a-b20b520718b8 Apr 17 16:38:10 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Setting Volume bf85ce23-1db3-4881-bd7a-b20b520718b8 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource bf85ce23-1db3-4881-bd7a-b20b520718b8 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:38:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (d6968a0a-f202-43f9-ab09-5880aadb825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:38:10 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-208fb94c-86af-4459-a279-1c8be9781cb3 tempest-CreateVolumesFromSnapshotTest-1535745892 None] Flow 'volume_create_scheduler' (e7455ddb-e5d5-4ecd-b26a-5fb285ce2ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:38:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=28,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:38:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Flow 'volume_create_scheduler' (a3a350ec-3f8a-4c20-b972-7e5168905476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:38:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (204b6a87-37c3-42a2-9532-9ac58d3054fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:38:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (204b6a87-37c3-42a2-9532-9ac58d3054fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(7384f51d-c3a2-4eea-a968-ec043946989f),volume_id=7384f51d-c3a2-4eea-a968-ec043946989f,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:38:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bfc3469d-13e9-43fd-9ebc-01222736a671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:38:19 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Error scheduling 7384f51d-c3a2-4eea-a968-ec043946989f from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:38:19 user cinder-scheduler[84081]: INFO cinder.message.api [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Creating message record for request_id = req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 Apr 17 16:38:20 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:38:20 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 7384f51d-c3a2-4eea-a968-ec043946989f: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 7384f51d-c3a2-4eea-a968-ec043946989f Apr 17 16:38:20 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Setting Volume 7384f51d-c3a2-4eea-a968-ec043946989f to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 7384f51d-c3a2-4eea-a968-ec043946989f {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:38:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (bfc3469d-13e9-43fd-9ebc-01222736a671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:38:20 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-3219fc38-5e4d-4f3e-8600-f93c79e36e17 tempest-CinderUnicodeTest-617908546 None] Flow 'volume_create_scheduler' (a3a350ec-3f8a-4c20-b972-7e5168905476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:38:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (f20a9844-cc1a-4fd8-ab88-145958ef7608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:38:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (00e217f3-a021-4f92-89c3-90ab3ae6a2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:38:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (00e217f3-a021-4f92-89c3-90ab3ae6a2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(480a94a0-d1c9-46c0-bf9f-c42f907b4b82),volume_id=480a94a0-d1c9-46c0-bf9f-c42f907b4b82,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:38:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (824a784a-8db8-4069-b49c-23f53f45fd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:38:23 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Error scheduling 480a94a0-d1c9-46c0-bf9f-c42f907b4b82 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:38:23 user cinder-scheduler[84081]: INFO cinder.message.api [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Creating message record for request_id = req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b Apr 17 16:38:23 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:38:23 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource 480a94a0-d1c9-46c0-bf9f-c42f907b4b82: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource 480a94a0-d1c9-46c0-bf9f-c42f907b4b82 Apr 17 16:38:23 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Setting Volume 480a94a0-d1c9-46c0-bf9f-c42f907b4b82 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource 480a94a0-d1c9-46c0-bf9f-c42f907b4b82 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:38:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (824a784a-8db8-4069-b49c-23f53f45fd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:38:23 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-f9284730-0ae4-46e6-8ee4-ca54c9c1c03b tempest-VolumeQuotasAdminTestJSON-623147042 None] Flow 'volume_create_scheduler' (f20a9844-cc1a-4fd8-ab88-145958ef7608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:38:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=8,cinder:SELECT=22,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:39:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:39:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Flow 'volume_create_scheduler' (4afd5322-2187-4328-b222-2b18945c53ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:39:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3cf098e7-13da-43f0-a2aa-84fc83436a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:39:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3cf098e7-13da-43f0-a2aa-84fc83436a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e1bb78ac-29e3-46df-9bbe-3b152e39b69a),volume_id=e1bb78ac-29e3-46df-9bbe-3b152e39b69a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:39:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (42aea006-2297-4e08-a3a5-900a5772e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:39:24 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Error scheduling e1bb78ac-29e3-46df-9bbe-3b152e39b69a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:39:24 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 40, total_capacity_gb: 119, allocated_capacity_gb: 82, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 82, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:38:07.616078 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (e1bb78ac-29e3-46df-9bbe-3b152e39b69a) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 40, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 82, 'calculated_free_capacity': 37.0, 'virtual_free_capacity': 37.0, 'free_percent': 31.09, 'provisioned_ratio': 0.69, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/37.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 40, total_capacity_gb: 119, allocated_capacity_gb: 82, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 82, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:38:07.616078] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Weigher CapacityWeigher returned, weigher value is {max: 37.0, min: 37.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:39:25.019747 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (42aea006-2297-4e08-a3a5-900a5772e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:39:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Flow 'volume_create_scheduler' (4afd5322-2187-4328-b222-2b18945c53ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Flow 'volume_create_scheduler' (708ad833-e36e-4eda-a0fc-87bd0e47a90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e20cd7ba-afb1-4b14-a61f-c20fa350503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (e20cd7ba-afb1-4b14-a61f-c20fa350503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b3e2b070-7732-4096-b59e-bdd77e430bbf),volume_id=b3e2b070-7732-4096-b59e-bdd77e430bbf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b87c8f81-a6ff-4ffe-aac2-a487130942d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b3e2b070-7732-4096-b59e-bdd77e430bbf) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 39, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 83, 'calculated_free_capacity': 36.0, 'virtual_free_capacity': 36.0, 'free_percent': 30.25, 'provisioned_ratio': 0.7, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/36.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:39:25.019747] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Weigher CapacityWeigher returned, weigher value is {max: 36.0, min: 36.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 38, total_capacity_gb: 119, allocated_capacity_gb: 84, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 84, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:40:01.962942 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (b87c8f81-a6ff-4ffe-aac2-a487130942d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:40:01 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Flow 'volume_create_scheduler' (708ad833-e36e-4eda-a0fc-87bd0e47a90d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Flow 'volume_create_scheduler' (577cbd1c-1563-47ca-bc97-b1d76dab5ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (95e29b32-5b19-4474-8b5e-54c5485eb056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (95e29b32-5b19-4474-8b5e-54c5485eb056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f920a5f7-106a-4092-b193-c3d340118d77),volume_id=f920a5f7-106a-4092-b193-c3d340118d77,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eb34fc59-bca9-4902-ab6e-1d9da18b4603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:40:25 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Error scheduling f920a5f7-106a-4092-b193-c3d340118d77 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:40:01.962942 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f920a5f7-106a-4092-b193-c3d340118d77) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 39, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 83, 'calculated_free_capacity': 36.0, 'virtual_free_capacity': 36.0, 'free_percent': 30.25, 'provisioned_ratio': 0.7, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/36.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:40:01.962942] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Weigher CapacityWeigher returned, weigher value is {max: 36.0, min: 36.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 38, total_capacity_gb: 119, allocated_capacity_gb: 84, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 84, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:40:25.877737 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (eb34fc59-bca9-4902-ab6e-1d9da18b4603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:40:25 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Flow 'volume_create_scheduler' (577cbd1c-1563-47ca-bc97-b1d76dab5ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:40:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=28,cinder:UPDATE=7 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:41:04 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:41:34 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:41:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Flow 'volume_create_scheduler' (92070783-8f1a-4b5b-bfd4-d013cbe4da02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:41:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a822f5dd-6220-417a-bb2a-d9739190298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:41:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (a822f5dd-6220-417a-bb2a-d9739190298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(e1bb78ac-29e3-46df-9bbe-3b152e39b69a),volume_id=e1bb78ac-29e3-46df-9bbe-3b152e39b69a,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:41:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0784ca09-d18f-4ca6-b9e3-a34278f4e5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:41:44 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Error scheduling e1bb78ac-29e3-46df-9bbe-3b152e39b69a from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:41:44 user cinder-scheduler[84081]: INFO cinder.message.api [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Creating message record for request_id = req-26b6ca51-cba9-4420-975a-eec85c094fd9 Apr 17 16:41:44 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:41:44 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource e1bb78ac-29e3-46df-9bbe-3b152e39b69a: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource e1bb78ac-29e3-46df-9bbe-3b152e39b69a Apr 17 16:41:44 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Setting Volume e1bb78ac-29e3-46df-9bbe-3b152e39b69a to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource e1bb78ac-29e3-46df-9bbe-3b152e39b69a {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:41:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (0784ca09-d18f-4ca6-b9e3-a34278f4e5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:41:44 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-26b6ca51-cba9-4420-975a-eec85c094fd9 tempest-VolumesMetadataTest-779181867 None] Flow 'volume_create_scheduler' (92070783-8f1a-4b5b-bfd4-d013cbe4da02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:42:14 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Flow 'volume_create_scheduler' (3ae4977f-4294-4ea1-ac1a-59b5aa492ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ba87f6f7-21f4-4b75-99b0-63ce1f096f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (ba87f6f7-21f4-4b75-99b0-63ce1f096f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b3e2b070-7732-4096-b59e-bdd77e430bbf),volume_id=b3e2b070-7732-4096-b59e-bdd77e430bbf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4f5eb76d-8c8f-4b77-b03a-9be95d5cd945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:42:19 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Error scheduling b3e2b070-7732-4096-b59e-bdd77e430bbf from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:40:25.877737 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b3e2b070-7732-4096-b59e-bdd77e430bbf) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 39, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 83, 'calculated_free_capacity': 36.0, 'virtual_free_capacity': 36.0, 'free_percent': 30.25, 'provisioned_ratio': 0.7, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/36.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:40:25.877737] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Weigher CapacityWeigher returned, weigher value is {max: 36.0, min: 36.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 38, total_capacity_gb: 119, allocated_capacity_gb: 84, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 84, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:42:19.893570 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4f5eb76d-8c8f-4b77-b03a-9be95d5cd945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:42:19 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Flow 'volume_create_scheduler' (3ae4977f-4294-4ea1-ac1a-59b5aa492ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Flow 'volume_create_scheduler' (e758c9db-4ed3-469a-817d-810c246d2dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (98a76edd-b82f-43f5-b118-abfc4c6cf0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (98a76edd-b82f-43f5-b118-abfc4c6cf0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f920a5f7-106a-4092-b193-c3d340118d77),volume_id=f920a5f7-106a-4092-b193-c3d340118d77,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4d8a2aa1-6ed8-49e7-a5d2-03eff1459bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:42:43 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Error scheduling f920a5f7-106a-4092-b193-c3d340118d77 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:42:19.893570 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (f920a5f7-106a-4092-b193-c3d340118d77) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 39, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 83, 'calculated_free_capacity': 36.0, 'virtual_free_capacity': 36.0, 'free_percent': 30.25, 'provisioned_ratio': 0.7, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/36.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:42:19.893570] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Weigher CapacityWeigher returned, weigher value is {max: 36.0, min: 36.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 38, total_capacity_gb: 119, allocated_capacity_gb: 84, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 84, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:42:43.196819 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (4d8a2aa1-6ed8-49e7-a5d2-03eff1459bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:42:43 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Flow 'volume_create_scheduler' (e758c9db-4ed3-469a-817d-810c246d2dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:42:54 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=28,cinder:UPDATE=8 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:43:24 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:43:55 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:44:25 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Flow 'volume_create_scheduler' (b9ced495-925b-46b2-bdd8-297012b47eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3dc1c2a5-8d9e-46ca-b87f-ed07bf4a4c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (3dc1c2a5-8d9e-46ca-b87f-ed07bf4a4c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b3e2b070-7732-4096-b59e-bdd77e430bbf),volume_id=b3e2b070-7732-4096-b59e-bdd77e430bbf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:44:38 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7e90ee55-af5c-4276-958e-d586d57baef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:44:38 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Error scheduling b3e2b070-7732-4096-b59e-bdd77e430bbf from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Consumed -1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:42:43.196819 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Updating capabilities for user@joviandss-2#joviandss-2: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': ['iSCSI', 'iscsi'], 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'allocated_capacity_gb': 16, 'cacheable': True, 'filter_function': None, 'goodness_function': None, 'timestamp': datetime.datetime(2023, 4, 17, 15, 27, 55, 236480)} {{(pid=84081) update_from_volume_capability /opt/stack/cinder/cinder/scheduler/host_manager.py:415}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Starting with 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:97}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filter AvailabilityZoneFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Checking if host user@joviandss-2#joviandss-2 can create a 1 GB volume (b3e2b070-7732-4096-b59e-bdd77e430bbf) {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:57}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Storage Capacity factors {'total_capacity': 119.0, 'free_capacity': 39, 'reserved_capacity': 0, 'total_reserved_available_capacity': 119.0, 'max_over_subscription_ratio': None, 'total_available_capacity': 119.0, 'provisioned_capacity': 83, 'calculated_free_capacity': 36.0, 'virtual_free_capacity': 36.0, 'free_percent': 30.25, 'provisioned_ratio': 0.7, 'provisioned_type': 'thick'} {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:137}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filters.capacity_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Space information for volume creation on host user@joviandss-2#joviandss-2 (requested / avail): 1/36.0 {{(pid=84081) backend_passes /opt/stack/cinder/cinder/scheduler/filters/capacity_filter.py:209}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filter CapacityFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_filter [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filter CapabilitiesFilter returned 1 host(s) {{(pid=84081) get_filtered_objects /opt/stack/cinder/cinder/scheduler/base_filter.py:125}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Filtered [host 'user@joviandss-2#joviandss-2': free_capacity_gb: 39, total_capacity_gb: 119, allocated_capacity_gb: 83, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 83, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:42:43.196819] {{(pid=84081) _get_weighted_candidates /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:358}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.base_weight [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Weigher CapacityWeigher returned, weigher value is {max: 36.0, min: 36.0} {{(pid=84081) get_weighed_objects /opt/stack/cinder/cinder/scheduler/base_weight.py:156}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Weighed [WeighedHost [host: user@joviandss-2#joviandss-2, weight: 0.0]] {{(pid=84081) get_weighed_backends /opt/stack/cinder/cinder/scheduler/host_manager.py:565}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.filter_scheduler [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Choosing user@joviandss-2#joviandss-2 {{(pid=84081) _choose_top_backend /opt/stack/cinder/cinder/scheduler/filter_scheduler.py:594}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.host_manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Consumed 1 GB from backend: host 'user@joviandss-2#joviandss-2': free_capacity_gb: 38, total_capacity_gb: 119, allocated_capacity_gb: 84, max_over_subscription_ratio: 1.0, reserved_percentage: 0, provisioned_capacity_gb: 84, thin_provisioning_support: False, thick_provisioning_support: False, pools: {}, updated at: 2023-04-17 16:44:39.023702 {{(pid=84081) consume_from_volume /opt/stack/cinder/cinder/scheduler/host_manager.py:354}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (7e90ee55-af5c-4276-958e-d586d57baef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:44:39 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Flow 'volume_create_scheduler' (b9ced495-925b-46b2-bdd8-297012b47eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:45:02 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=18,cinder:UPDATE=5 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:45:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Flow 'volume_create_scheduler' (a3a83306-1579-46aa-94f5-2e01d512e611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:45:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (959a06e2-c68e-416d-a5ee-42e2f1288ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:45:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (959a06e2-c68e-416d-a5ee-42e2f1288ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(f920a5f7-106a-4092-b193-c3d340118d77),volume_id=f920a5f7-106a-4092-b193-c3d340118d77,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:45:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ca6f4f1f-a653-414b-88c7-4443d830773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:45:02 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Error scheduling f920a5f7-106a-4092-b193-c3d340118d77 from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:45:02 user cinder-scheduler[84081]: INFO cinder.message.api [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Creating message record for request_id = req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 Apr 17 16:45:02 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:45:02 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource f920a5f7-106a-4092-b193-c3d340118d77: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource f920a5f7-106a-4092-b193-c3d340118d77 Apr 17 16:45:02 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Setting Volume f920a5f7-106a-4092-b193-c3d340118d77 to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource f920a5f7-106a-4092-b193-c3d340118d77 {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:45:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (ca6f4f1f-a653-414b-88c7-4443d830773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:45:02 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-a237a7e2-7b3e-4cba-90d3-8187cea21e78 tempest-VolumesActionsTest-90490071 None] Flow 'volume_create_scheduler' (a3a83306-1579-46aa-94f5-2e01d512e611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:45:35 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:46:15 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:46:45 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:46:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Flow 'volume_create_scheduler' (584848a6-d783-47b2-af2c-0e7ce2a0f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:46:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b70f25a4-0387-4d16-933c-023fec2576c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:46:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ExtractSchedulerSpecTask;volume:create' (b70f25a4-0387-4d16-933c-023fec2576c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'request_spec': RequestSpec(CG_backend=,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=,group_id=None,image_id=None,operation=,resource_backend=,snapshot_id=None,source_replicaid=,source_volid=None,volume=Volume(b3e2b070-7732-4096-b59e-bdd77e430bbf),volume_id=b3e2b070-7732-4096-b59e-bdd77e430bbf,volume_properties=VolumeProperties,volume_type=VolumeType(6051bd20-d4fe-472e-ac09-f3c9b04bd00c))}' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:46:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (81bcfb2f-fe58-493c-9936-0d8a8fec0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 17 16:46:59 user cinder-scheduler[84081]: ERROR cinder.scheduler.filter_scheduler [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Error scheduling b3e2b070-7732-4096-b59e-bdd77e430bbf from last vol-service: user@joviandss-2#joviandss-2 : ['Traceback (most recent call last):\n', ' File "/usr/local/lib/python3.10/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task\n result = task.execute(**arguments)\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1228, in execute\n model_update = self._create_raw_volume(\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1191, in _create_raw_volume\n with excutils.save_and_reraise_exception():\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__\n self.force_reraise()\n', ' File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise\n raise self.value\n', ' File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1189, in _create_raw_volume\n ret = self.driver.create_volume(volume)\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 151, in create_volume\n self.ra.create_lun(vname,\n', ' File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 138, in create_lun\n if not resp["error"] and resp["code"] in (200, 201):\n', "TypeError: 'NoneType' object is not subscriptable\n"] Apr 17 16:46:59 user cinder-scheduler[84081]: INFO cinder.message.api [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Creating message record for request_id = req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f Apr 17 16:46:59 user cinder-scheduler[84081]: DEBUG oslo_db.sqlalchemy.engines [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84081) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 16:46:59 user cinder-scheduler[84081]: ERROR cinder.scheduler.flows.create_volume [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Failed to run task cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid backend was found. Exceeded max scheduling attempts 3 for resource b3e2b070-7732-4096-b59e-bdd77e430bbf: cinder.exception.NoValidBackend: No valid backend was found. Exceeded max scheduling attempts 3 for resource b3e2b070-7732-4096-b59e-bdd77e430bbf Apr 17 16:46:59 user cinder-scheduler[84081]: DEBUG cinder.volume.flows.common [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Setting Volume b3e2b070-7732-4096-b59e-bdd77e430bbf to error due to: No valid backend was found. Exceeded max scheduling attempts 3 for resource b3e2b070-7732-4096-b59e-bdd77e430bbf {{(pid=84081) error_out /opt/stack/cinder/cinder/volume/flows/common.py:81}} Apr 17 16:46:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Task 'cinder.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create' (81bcfb2f-fe58-493c-9936-0d8a8fec0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84081) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 17 16:46:59 user cinder-scheduler[84081]: DEBUG cinder.scheduler.manager [None req-47547a7c-26c7-42c9-a7cd-c9d95e4ea81f tempest-SnapshotDataIntegrityTests-793909213 None] Flow 'volume_create_scheduler' (584848a6-d783-47b2-af2c-0e7ce2a0f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84081) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 17 16:47:15 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:UPDATE=5,cinder:SELECT=13,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:47:55 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 16:48:25 user cinder-scheduler[84081]: DEBUG dbcounter [-] [84081] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=84081) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}